Jul 24 03:16:14.346299 ip-10-0-134-231 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 24 03:16:14.346309 ip-10-0-134-231 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 24 03:16:14.346316 ip-10-0-134-231 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 24 03:16:14.346564 ip-10-0-134-231 systemd[1]: Failed to start Kubernetes Kubelet. Jul 24 03:16:24.394674 ip-10-0-134-231 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 24 03:16:24.394692 ip-10-0-134-231 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 71bf5a39e9fd48c6a690bc49b7cca9d0 -- Jul 24 03:18:16.379649 ip-10-0-134-231 systemd[1]: Starting Kubernetes Kubelet... Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.806025 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811699 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811716 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811724 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811732 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811737 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811742 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811747 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:18:16.848137 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811751 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811755 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811760 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811764 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811768 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811772 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811777 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811781 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811785 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811789 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811794 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811797 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811802 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811806 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811810 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811814 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811819 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811824 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811828 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811837 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:18:16.849900 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811842 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811846 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811849 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811854 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811858 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811862 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811866 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811871 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811876 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811879 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811883 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811889 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811893 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811897 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811901 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811905 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811909 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811913 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811918 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:18:16.850611 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811922 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811928 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811932 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811937 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811941 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811944 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811948 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811953 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811957 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811963 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811971 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811976 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811981 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811987 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811991 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811995 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.811999 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812004 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812008 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:18:16.852708 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812013 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812019 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812024 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812030 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812034 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812039 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812044 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812048 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812053 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812057 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812062 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812066 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812070 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812074 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812078 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812084 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812089 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812093 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812097 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812101 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:18:16.853609 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812106 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812111 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812114 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812120 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812124 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812129 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812133 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812137 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812141 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812145 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812149 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812154 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812158 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.812162 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813285 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813296 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813300 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813304 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813308 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813313 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:18:16.856120 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813317 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813321 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813325 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813329 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813334 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813339 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813342 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813347 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813352 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813356 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813361 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813365 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813391 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813395 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813399 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813404 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813409 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813413 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813417 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:18:16.856855 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813424 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813429 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813434 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813439 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813443 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813447 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813452 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813457 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813461 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813466 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813470 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813475 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813479 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813483 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813487 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813491 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813495 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813498 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813504 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:18:16.857783 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813510 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813514 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813520 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813525 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813530 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813534 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813538 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813542 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813547 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813552 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813558 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813563 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813568 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813573 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813578 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813582 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813587 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813593 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813598 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:18:16.858355 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813603 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813607 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813611 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813615 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813619 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813623 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813627 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813631 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813635 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813639 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813643 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813647 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813651 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813655 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813660 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813664 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813668 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813673 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813677 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813681 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:18:16.859123 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813686 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813691 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813695 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813698 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813703 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813707 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813710 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813715 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813719 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813723 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813727 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813731 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813736 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813739 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813744 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.813748 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814328 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814335 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814339 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814344 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:18:16.859766 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814348 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814353 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814357 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814361 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814365 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814387 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814391 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814396 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814400 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814406 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814411 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814416 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814424 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814428 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814433 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814437 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814441 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814445 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814449 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814453 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:18:16.860621 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814458 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814462 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814466 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814471 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814475 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814479 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814483 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814488 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814492 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814496 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814500 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814506 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814512 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814516 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814521 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814525 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814529 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814533 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814538 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:18:16.861214 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814543 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814547 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814552 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814556 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814560 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814567 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814571 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814575 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814579 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814584 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814588 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814592 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814596 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814600 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814605 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814609 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814613 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814617 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814621 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814625 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:18:17.050153 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814630 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:18:16.889199 ip-10-0-134-231 systemd[1]: Started Kubernetes Kubelet. Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814634 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814638 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814642 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814646 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814651 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814655 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814658 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814662 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814666 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814671 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814685 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814689 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814693 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814697 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814701 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814706 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814712 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814716 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814720 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:18:17.067260 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814723 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814727 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814731 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814735 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814739 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814743 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814747 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814751 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814755 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814759 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814763 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814767 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814771 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814775 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814780 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.814786 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814887 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814897 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814907 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814914 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814920 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 03:18:17.069655 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814925 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814931 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814938 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814943 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814948 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814953 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814959 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814963 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814973 2564 flags.go:64] FLAG: --cgroup-root="" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814978 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814983 2564 flags.go:64] FLAG: --client-ca-file="" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814988 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.814993 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815003 2564 flags.go:64] FLAG: --cluster-domain="" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815007 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815013 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815018 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815023 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815029 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815035 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815040 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815045 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815050 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815055 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 03:18:17.070471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815060 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815065 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815070 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815077 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815082 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815087 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815091 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815096 2564 flags.go:64] FLAG: --enable-server="true" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815101 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815107 2564 flags.go:64] FLAG: --event-burst="100" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815112 2564 flags.go:64] FLAG: --event-qps="50" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815116 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815121 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815128 2564 flags.go:64] FLAG: --eviction-hard="" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815134 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815139 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815144 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815150 2564 flags.go:64] FLAG: --eviction-soft="" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815155 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815160 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815165 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815169 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815174 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815178 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815183 2564 flags.go:64] FLAG: --feature-gates="" Jul 24 03:18:17.071415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815188 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815193 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815198 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815203 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815208 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815213 2564 flags.go:64] FLAG: --help="false" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815217 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815222 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815227 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815231 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815237 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815242 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815247 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815251 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815255 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815259 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815264 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815269 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815273 2564 flags.go:64] FLAG: --kube-reserved="" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815278 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815284 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815289 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815293 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815300 2564 flags.go:64] FLAG: --lock-file="" Jul 24 03:18:17.072265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815304 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815313 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815319 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815327 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815331 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815336 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815341 2564 flags.go:64] FLAG: --logging-format="text" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815345 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815350 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815355 2564 flags.go:64] FLAG: --manifest-url="" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815359 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815380 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815386 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815393 2564 flags.go:64] FLAG: --max-pods="110" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815397 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815402 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815407 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815412 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815417 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815421 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815426 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815438 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815442 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815447 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 03:18:17.073418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815451 2564 flags.go:64] FLAG: --pod-cidr="" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815456 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815465 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815470 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815476 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815481 2564 flags.go:64] FLAG: --port="10250" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815486 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815491 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d32c4b39344965cd" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815500 2564 flags.go:64] FLAG: --qos-reserved="" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815505 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815510 2564 flags.go:64] FLAG: --register-node="true" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815515 2564 flags.go:64] FLAG: --register-with-taints="" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815521 2564 flags.go:64] FLAG: --registry-burst="10" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815525 2564 flags.go:64] FLAG: --registry-qps="5" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815530 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815534 2564 flags.go:64] FLAG: --reserved-memory="" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815541 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815545 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815551 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815556 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815561 2564 flags.go:64] FLAG: --runonce="false" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815566 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815570 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815575 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815580 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 03:18:17.074218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815584 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815589 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815594 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815599 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815603 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815608 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815612 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815617 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815621 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815626 2564 flags.go:64] FLAG: --system-cgroups="" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815630 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815641 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815645 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815649 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815656 2564 flags.go:64] FLAG: --tls-min-version="" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815662 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815667 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815671 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815678 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815683 2564 flags.go:64] FLAG: --v="2" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815689 2564 flags.go:64] FLAG: --version="false" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815695 2564 flags.go:64] FLAG: --vmodule="" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815701 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.815706 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815891 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:18:17.075429 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815896 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815901 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815905 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815911 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815915 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815920 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815925 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815929 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815933 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815937 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815941 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815945 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815950 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815954 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815958 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815963 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815967 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815971 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815977 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815982 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:18:17.076269 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815986 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815990 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.815996 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816000 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816004 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816008 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816015 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816019 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816024 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816029 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816033 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816037 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816041 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816045 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816050 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816054 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816058 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816063 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816067 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:18:17.076977 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816071 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816075 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816080 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816084 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816088 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816092 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816096 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816101 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816105 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816109 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816113 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816119 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816123 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816127 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816131 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816137 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816141 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816147 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816152 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:18:17.295410 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816157 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816162 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816167 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816172 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816176 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816180 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816184 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816188 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816194 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816199 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816203 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816207 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816212 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816215 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816219 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816223 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816227 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816231 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816235 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:18:17.296160 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816239 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816243 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816247 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816251 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816256 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816261 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816265 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816269 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816273 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816278 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816283 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816287 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816291 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816295 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816299 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816304 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816308 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816312 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816316 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816320 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:18:17.296888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.816324 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.816974 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.824841 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.824859 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.824875 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.824886 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824951 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824956 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824960 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824964 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824967 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824971 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824975 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824978 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824981 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:18:17.297723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824984 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824988 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824991 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824994 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.824997 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825001 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825005 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825008 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825011 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825014 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825017 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825020 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825023 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825026 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825029 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825032 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825035 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825038 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825040 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825044 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:18:17.298365 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825047 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825050 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825053 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825055 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825059 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825061 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825064 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825067 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825070 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825072 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825075 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825078 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825081 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825084 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825086 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825089 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825092 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825097 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825101 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:18:17.300583 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825104 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825106 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825109 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825114 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825117 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825120 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825122 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825125 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825128 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825131 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825134 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825137 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825141 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825146 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825156 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825160 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825163 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825166 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825169 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:18:17.301238 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825171 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825174 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825176 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825179 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825182 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825185 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825187 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825190 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825193 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825195 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825198 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825202 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825205 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825208 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825211 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825214 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825218 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825221 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825224 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825227 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:18:17.543560 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825230 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825232 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825235 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825238 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825240 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825243 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825246 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825249 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825257 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825262 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825266 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.825269 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.825274 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827565 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:18:17.545023 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827577 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827581 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827584 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827588 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827591 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827594 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827599 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827604 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827607 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827610 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827615 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827618 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827621 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827624 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827628 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827631 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827634 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827636 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827639 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827642 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:18:17.546242 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827645 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827648 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827651 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827654 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827656 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827659 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827662 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827666 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827668 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827671 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827674 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827677 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827680 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827683 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827685 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827688 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827691 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827693 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827696 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827699 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:18:17.546880 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827702 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827705 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827709 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827712 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827714 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827717 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827725 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827728 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827731 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827734 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827737 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827739 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827742 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827745 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827748 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827750 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827753 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827756 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827758 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827761 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:18:17.547485 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827765 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827768 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827771 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827773 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827776 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827779 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827781 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827784 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827787 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827790 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827793 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827795 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827800 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827803 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827810 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827813 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827816 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827819 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827824 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:18:17.548222 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827827 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827830 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827833 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827836 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827839 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827843 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827846 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827849 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827852 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827855 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827857 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827860 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827863 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827866 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827869 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827872 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827875 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827877 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:18:17.548801 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:16.827880 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.827886 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.828019 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.830458 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.831943 2564 server.go:1019] "Starting client certificate rotation" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.832047 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.832081 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.836362 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.837676 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.853982 2564 log.go:25] "Validated CRI v1 runtime API" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.856289 2564 log.go:25] "Validated CRI v1 image API" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.857277 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 03:18:17.549428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.859684 2564 fs.go:135] Filesystem UUIDs: map[3f64c842-b6a4-4cb7-abcf-bfffbc8d0d33:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b39c77f4-6eeb-4f6f-9f1e-147b9cafd38b:/dev/nvme0n1p4] Jul 24 03:18:17.770321 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.859709 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 03:18:17.770321 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.862933 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.866150 2564 manager.go:216] Machine: {Timestamp:2026-07-24 03:18:16.864675032 +0000 UTC m=+0.364178366 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098840 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29b6462ec28c8764363766d981b7ab SystemUUID:ec29b646-2ec2-8c87-6436-3766d981b7ab BootID:71bf5a39-e9fd-48c6-a690-bc49b7cca9d0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f9:90:88:12:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f9:90:88:12:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:84:b6:15:a6:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.866270 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.866363 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.870318 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.870358 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-231.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.871333 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.871347 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.871357 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.872219 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.873605 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.876989 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.877143 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.877175 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.877193 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.877209 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.877219 2564 kubelet.go:398] "Adding apiserver pod source" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.877230 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 03:18:17.771938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.877634 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.877650 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.880614 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.881994 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882024 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882695 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882709 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882717 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882723 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882732 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882738 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882880 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882887 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882903 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882911 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882934 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.882947 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.884561 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.884571 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.887812 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qkhnt" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.888504 2564 server.go:1268] "Started kubelet" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.891714 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.891889 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.891973 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.892526 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-231.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.893570 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.893704 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.896730 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qkhnt" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.897547 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-231.ec2.internal.18c51b87aebdc987 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-231.ec2.internal,UID:ip-10-0-134-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-231.ec2.internal,},FirstTimestamp:2026-07-24 03:18:16.888478087 +0000 UTC m=+0.387981422,LastTimestamp:2026-07-24 03:18:16.888478087 +0000 UTC m=+0.387981422,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-231.ec2.internal,}" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.902136 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.902200 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.903083 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.903341 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.903459 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.904874 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.905518 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.905535 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.906218 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.906502 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 24 03:18:17.772552 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.906513 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.914155 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.914297 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.915234 2564 factory.go:55] Registering systemd factory Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.915278 2564 factory.go:223] Registration of the systemd container factory successfully Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.916359 2564 factory.go:153] Registering CRI-O factory Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.916380 2564 factory.go:223] Registration of the crio container factory successfully Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.916444 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.916480 2564 factory.go:103] Registering Raw factory Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.916500 2564 manager.go:1196] Started watching for new ooms in manager Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.917138 2564 manager.go:349] Starting recovery of all containers Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.930598 2564 manager.go:354] Recovery completed Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.934866 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.936995 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.937026 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.937037 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.937640 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.937652 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.937666 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.937673 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.938395 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.938425 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.938438 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.939193 2564 policy_none.go:49] "None policy: Start" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.939208 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.939219 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.940302 2564 policy_none.go:47] "Start" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.943211 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-231.ec2.internal.18c51b87b1a2540c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-231.ec2.internal,UID:ip-10-0-134-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-231.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-231.ec2.internal,},FirstTimestamp:2026-07-24 03:18:16.937010188 +0000 UTC m=+0.436513525,LastTimestamp:2026-07-24 03:18:16.937010188 +0000 UTC m=+0.436513525,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-231.ec2.internal,}" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.979516 2564 manager.go:337] "Starting Device Plugin manager" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.979551 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.979562 2564 server.go:87] "Starting device plugin registration server" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.979855 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.979870 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.980062 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.980130 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:16.980136 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.981936 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:16.981988 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.042713 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.044082 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.044122 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 03:18:17.773675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.044189 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.044236 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.047208 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.080554 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.085104 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.085136 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.085147 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.085172 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.093634 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.093657 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-231.ec2.internal\": node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.110208 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.145182 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal"] Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.145264 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.146702 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.146732 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.146751 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.148198 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.148338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.148365 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.148983 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.149012 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.149022 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.148984 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.149082 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.149098 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.150428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.150450 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.151224 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.151251 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.151261 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.185558 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-231.ec2.internal\" not found" node="ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.190515 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-231.ec2.internal\" not found" node="ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.207642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a396f40636e367bf35305e84479730c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-231.ec2.internal\" (UID: \"6a396f40636e367bf35305e84479730c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.774818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.207682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1e568223003c8fbc9f4090069624023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal\" (UID: \"b1e568223003c8fbc9f4090069624023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.207713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e568223003c8fbc9f4090069624023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal\" (UID: \"b1e568223003c8fbc9f4090069624023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.210947 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.308840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a396f40636e367bf35305e84479730c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-231.ec2.internal\" (UID: \"6a396f40636e367bf35305e84479730c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.308867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1e568223003c8fbc9f4090069624023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal\" (UID: \"b1e568223003c8fbc9f4090069624023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.308887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e568223003c8fbc9f4090069624023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal\" (UID: \"b1e568223003c8fbc9f4090069624023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.308930 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1e568223003c8fbc9f4090069624023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal\" (UID: \"b1e568223003c8fbc9f4090069624023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.308956 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a396f40636e367bf35305e84479730c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-231.ec2.internal\" (UID: \"6a396f40636e367bf35305e84479730c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.308960 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1e568223003c8fbc9f4090069624023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal\" (UID: \"b1e568223003c8fbc9f4090069624023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.311050 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.412580 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.493344 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.494495 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.513191 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.614030 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.714212 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.775721 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.734120 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:18:17.814501 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.814408 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.831875 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.831843 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 03:18:17.832042 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.832014 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 03:18:17.832085 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.832014 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 03:18:17.914763 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:17.914735 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:17.914763 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.914742 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 03:13:17 +0000 UTC" deadline="2028-03-24 07:56:17.428071048 +0000 UTC" Jul 24 03:18:17.914763 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.914768 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14620h37m59.513306029s" Jul 24 03:18:17.980099 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:17.980064 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:18:18.014902 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:18.014865 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:18.115884 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:18.115813 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:18.134344 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:18.134295 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a396f40636e367bf35305e84479730c.slice/crio-16a513f2ab0b12918581f3c1018de4216c3405360e1b286a5310c509818cdf3c WatchSource:0}: Error finding container 16a513f2ab0b12918581f3c1018de4216c3405360e1b286a5310c509818cdf3c: Status 404 returned error can't find the container with id 16a513f2ab0b12918581f3c1018de4216c3405360e1b286a5310c509818cdf3c Jul 24 03:18:18.134723 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:18.134709 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e568223003c8fbc9f4090069624023.slice/crio-f0d068cb33f7c627901cec0f2aec074576ba370de0dfebe0d3d510dc692bab81 WatchSource:0}: Error finding container f0d068cb33f7c627901cec0f2aec074576ba370de0dfebe0d3d510dc692bab81: Status 404 returned error can't find the container with id f0d068cb33f7c627901cec0f2aec074576ba370de0dfebe0d3d510dc692bab81 Jul 24 03:18:18.142387 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.142340 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 03:18:18.216489 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:18.216446 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:18.317589 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:18.317550 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-231.ec2.internal\" not found" Jul 24 03:18:18.331256 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.331224 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:18:18.406362 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.406264 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" Jul 24 03:18:18.422094 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.422067 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 03:18:18.423290 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.423276 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" Jul 24 03:18:18.443893 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.443864 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 03:18:18.880253 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.880167 2564 apiserver.go:52] "Watching apiserver" Jul 24 03:18:18.887885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.887849 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 03:18:18.889031 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.888992 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-rpdwb","kube-system/global-pull-secret-syncer-vm9zb","kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk","openshift-image-registry/node-ca-vlcvq","openshift-multus/multus-8plts","openshift-multus/network-metrics-daemon-t55cl","openshift-network-diagnostics/network-check-target-64mls","openshift-network-operator/iptables-alerter-ljwxt","kube-system/konnectivity-agent-8vzrn","openshift-cluster-node-tuning-operator/tuned-blt2m","openshift-dns/node-resolver-wpvxt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal","openshift-multus/multus-additional-cni-plugins-52fwn"] Jul 24 03:18:18.890904 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.890880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8plts" Jul 24 03:18:18.892223 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.892201 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.893514 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.893490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:18.894375 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.894353 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 03:18:18.894642 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.894618 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 03:18:18.895885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.894731 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 03:18:18.895885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.894822 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 03:18:18.895885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.894971 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 03:18:18.895885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.895017 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 03:18:18.895885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.895274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jb982\"" Jul 24 03:18:18.895885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.895518 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zsk7h\"" Jul 24 03:18:18.895885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.895577 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 03:18:18.895885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.895797 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:18.896317 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.896279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:18.897135 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.896592 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4pz46\"" Jul 24 03:18:18.897135 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:18.896692 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:18.897135 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.896818 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 03:18:18.898618 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.898589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:18.902893 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.900718 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 03:18:18.902893 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.902583 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 03:18:18.902893 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.901103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 03:18:18.903452 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.901024 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4t5w2\"" Jul 24 03:18:18.904290 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.903804 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 03:18:18.904290 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.904027 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bj64q\"" Jul 24 03:18:18.904290 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.904112 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 03:18:18.905742 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.905723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.906480 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.906456 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 03:18:18.906987 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.906967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:18.907201 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:18.907173 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:18.908845 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.908707 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 03:18:18.910218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.910201 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 03:18:18.910394 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.910362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-clwxh\"" Jul 24 03:18:18.912367 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.912347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:18.912823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.912803 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 03:18:18.912955 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.912912 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 03:18:18.913208 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.913188 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 03:18:18.913283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.913192 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 03:18:18.913559 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.913540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 03:18:18.914422 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.914156 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:18.917470 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.915963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:18.917470 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.916280 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:18:18.917470 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.916754 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 03:18:18.917470 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.916834 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 03:18:18.917470 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917103 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 03:18:18.917470 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917157 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r9zrw\"" Jul 24 03:18:18.917470 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917449 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rvhd9\"" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-cni-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-etc-kubernetes\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-cni-bin\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6kgr\" (UniqueName: \"kubernetes.io/projected/4dcb6911-69f1-42b6-8d89-5b8067f71555-kube-api-access-k6kgr\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwhl\" (UniqueName: \"kubernetes.io/projected/0f2e01cb-9153-413b-903e-faec524a75c0-kube-api-access-nmwhl\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258bd8cd-2ad8-4772-a488-b25587e7dfe5-tmp-dir\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-socket-dir-parent\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxxdd\" (UniqueName: \"kubernetes.io/projected/258bd8cd-2ad8-4772-a488-b25587e7dfe5-kube-api-access-zxxdd\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-cnibin\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-socket-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917854 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-sys-fs\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:18.918463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-node-log\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.917962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-ovnkube-config\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f2e01cb-9153-413b-903e-faec524a75c0-ovn-node-metrics-cert\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-conf-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-device-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-run-netns\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-systemd\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-etc-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-k8s-cni-cncf-io\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-daemon-config\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-kubelet\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-system-cni-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/287481bf-e7d1-4137-8c14-4ae1f30d6cad-cni-binary-copy\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-os-release\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.919544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-multus-certs\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mch6p\" (UniqueName: \"kubernetes.io/projected/6ae0ae01-14ed-441f-8b5c-398297a5183d-kube-api-access-mch6p\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-ovn\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-cni-netd\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-ovnkube-script-lib\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-cnibin\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-netns\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4l55\" (UniqueName: \"kubernetes.io/projected/287481bf-e7d1-4137-8c14-4ae1f30d6cad-kube-api-access-b4l55\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-slash\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-system-cni-dir\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-cni-binary-copy\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.918975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae0ae01-14ed-441f-8b5c-398297a5183d-host\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-registration-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:18.920498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-var-lib-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-kubelet\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-hostroot\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-log-socket\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-cni-multus\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w5l6\" (UniqueName: \"kubernetes.io/projected/362580f4-2da5-46f3-a4de-2a3d6843daec-kube-api-access-9w5l6\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919382 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-znqwz\"" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae0ae01-14ed-441f-8b5c-398297a5183d-serviceca\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/258bd8cd-2ad8-4772-a488-b25587e7dfe5-hosts-file\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-systemd-units\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-cni-bin\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919633 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-env-overrides\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919356 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.919837 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.920009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-os-release\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.920057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fcb5\" (UniqueName: \"kubernetes.io/projected/102160e4-3b43-4655-9beb-2cf422a84bcf-kube-api-access-4fcb5\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:18.921206 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.920600 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:18.922089 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:18.920672 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:18.922712 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.922689 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 03:18:18.942841 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.942809 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7zgvb" Jul 24 03:18:18.951431 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:18.951397 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7zgvb" Jul 24 03:18:19.007920 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.007823 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 03:18:19.020984 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.020799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/258bd8cd-2ad8-4772-a488-b25587e7dfe5-hosts-file\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:19.020984 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.020851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-systemd-units\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.020984 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.020881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-cni-bin\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.020984 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.020944 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-cni-bin\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.020984 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.020965 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-systemd-units\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-env-overrides\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/258bd8cd-2ad8-4772-a488-b25587e7dfe5-hosts-file\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-os-release\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021128 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-os-release\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f829dedf-b461-4aa8-842a-482275797914-host-slash\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysctl-d\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fcb5\" (UniqueName: \"kubernetes.io/projected/102160e4-3b43-4655-9beb-2cf422a84bcf-kube-api-access-4fcb5\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-kubernetes\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-host\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-cni-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.021414 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-etc-kubernetes\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-cni-bin\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021568 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-etc-kubernetes\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021587 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-cni-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-tuned\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021638 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-cni-bin\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021667 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-env-overrides\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkw6g\" (UniqueName: \"kubernetes.io/projected/3389a1ac-890a-4824-80fe-3085d9c6961b-kube-api-access-kkw6g\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6kgr\" (UniqueName: \"kubernetes.io/projected/4dcb6911-69f1-42b6-8d89-5b8067f71555-kube-api-access-k6kgr\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwhl\" (UniqueName: \"kubernetes.io/projected/0f2e01cb-9153-413b-903e-faec524a75c0-kube-api-access-nmwhl\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a10e2dae-e163-47bc-8954-b521f5fa6808-dbus\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258bd8cd-2ad8-4772-a488-b25587e7dfe5-tmp-dir\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-socket-dir-parent\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysctl-conf\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3389a1ac-890a-4824-80fe-3085d9c6961b-tmp\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.021960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxxdd\" (UniqueName: \"kubernetes.io/projected/258bd8cd-2ad8-4772-a488-b25587e7dfe5-kube-api-access-zxxdd\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.021990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-cnibin\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-socket-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-sys-fs\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-node-log\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022223 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258bd8cd-2ad8-4772-a488-b25587e7dfe5-tmp-dir\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-ovnkube-config\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f2e01cb-9153-413b-903e-faec524a75c0-ovn-node-metrics-cert\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-conf-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022387 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022433 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-socket-dir-parent\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022439 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-device-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022486 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-sys-fs\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.022832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-run-netns\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.023698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-cnibin\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.023698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022577 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-run-netns\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.023698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022592 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-socket-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.023698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-systemd\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.023698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-etc-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.023698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-conf-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.023698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022660 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-device-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.023698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.022706 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-systemd\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.023073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-etc-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.023610 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-ovnkube-config\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.023725 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-node-log\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.023827 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.023876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.023901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-k8s-cni-cncf-io\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.023926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-daemon-config\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.023975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/965b976e-9f19-44eb-8762-c8b1a4aec264-konnectivity-ca\") pod \"konnectivity-agent-8vzrn\" (UID: \"965b976e-9f19-44eb-8762-c8b1a4aec264\") " pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-kubelet\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-system-cni-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.024083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/287481bf-e7d1-4137-8c14-4ae1f30d6cad-cni-binary-copy\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5mqc\" (UniqueName: \"kubernetes.io/projected/f829dedf-b461-4aa8-842a-482275797914-kube-api-access-t5mqc\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-os-release\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-multus-certs\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mch6p\" (UniqueName: \"kubernetes.io/projected/6ae0ae01-14ed-441f-8b5c-398297a5183d-kube-api-access-mch6p\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024251 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-kubelet\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/965b976e-9f19-44eb-8762-c8b1a4aec264-agent-certs\") pod \"konnectivity-agent-8vzrn\" (UID: \"965b976e-9f19-44eb-8762-c8b1a4aec264\") " pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024427 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024493 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-system-cni-dir\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.024676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024492 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-k8s-cni-cncf-io\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.025132 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024834 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-multus-certs\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.025132 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-run\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.025132 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.024905 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-os-release\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.025132 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025055 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/287481bf-e7d1-4137-8c14-4ae1f30d6cad-cni-binary-copy\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.025132 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.025359 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-ovn\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.025427 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-cni-netd\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.025516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-ovnkube-script-lib\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.025516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-cnibin\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.025613 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-netns\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.025613 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025539 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/287481bf-e7d1-4137-8c14-4ae1f30d6cad-multus-daemon-config\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.025613 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4l55\" (UniqueName: \"kubernetes.io/projected/287481bf-e7d1-4137-8c14-4ae1f30d6cad-kube-api-access-b4l55\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.025755 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f829dedf-b461-4aa8-842a-482275797914-iptables-alerter-script\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.025805 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.025857 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-slash\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.025909 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-system-cni-dir\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.025909 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-cni-binary-copy\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.026008 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.025916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae0ae01-14ed-441f-8b5c-398297a5183d-host\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:19.026203 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-modprobe-d\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.026263 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysconfig\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.026316 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026257 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-system-cni-dir\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.026316 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-systemd\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.026316 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026306 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-run-netns\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.026495 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026321 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-slash\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.026495 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026345 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.026495 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026359 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae0ae01-14ed-441f-8b5c-398297a5183d-host\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:19.026495 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:19.026495 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-registration-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.026495 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-var-lib-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-kubelet\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026513 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-registration-dir\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-hostroot\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-var-lib-openvswitch\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-lib-modules\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026614 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-kubelet\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a10e2dae-e163-47bc-8954-b521f5fa6808-kubelet-config\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-log-socket\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-cni-multus\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.026825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w5l6\" (UniqueName: \"kubernetes.io/projected/362580f4-2da5-46f3-a4de-2a3d6843daec-kube-api-access-9w5l6\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026832 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/362580f4-2da5-46f3-a4de-2a3d6843daec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-sys\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026890 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-hostroot\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.026886 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/362580f4-2da5-46f3-a4de-2a3d6843daec-cni-binary-copy\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027002 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/102160e4-3b43-4655-9beb-2cf422a84bcf-etc-selinux\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027013 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-cni-netd\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027070 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-host-var-lib-cni-multus\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-run-ovn\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027125 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/287481bf-e7d1-4137-8c14-4ae1f30d6cad-cnibin\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae0ae01-14ed-441f-8b5c-398297a5183d-serviceca\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-var-lib-kubelet\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.027311 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:19.027340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027346 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.028156 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.027406 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs podName:4dcb6911-69f1-42b6-8d89-5b8067f71555 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:19.527382671 +0000 UTC m=+3.026886010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs") pod "network-metrics-daemon-t55cl" (UID: "4dcb6911-69f1-42b6-8d89-5b8067f71555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:19.028156 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f2e01cb-9153-413b-903e-faec524a75c0-ovnkube-script-lib\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.028156 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.027792 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae0ae01-14ed-441f-8b5c-398297a5183d-serviceca\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:19.029100 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.028433 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f2e01cb-9153-413b-903e-faec524a75c0-log-socket\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.032428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.032365 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f2e01cb-9153-413b-903e-faec524a75c0-ovn-node-metrics-cert\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.040310 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.040281 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:19.040310 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.040314 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:19.040526 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.040329 2564 projected.go:196] Error preparing data for projected volume kube-api-access-l76v5 for pod openshift-network-diagnostics/network-check-target-64mls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:19.040526 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.040429 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5 podName:7acb9d6e-7c72-40b5-a232-9e905d29cdf4 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:19.540406831 +0000 UTC m=+3.039910171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l76v5" (UniqueName: "kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5") pod "network-check-target-64mls" (UID: "7acb9d6e-7c72-40b5-a232-9e905d29cdf4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:19.043241 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.042934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4l55\" (UniqueName: \"kubernetes.io/projected/287481bf-e7d1-4137-8c14-4ae1f30d6cad-kube-api-access-b4l55\") pod \"multus-8plts\" (UID: \"287481bf-e7d1-4137-8c14-4ae1f30d6cad\") " pod="openshift-multus/multus-8plts" Jul 24 03:18:19.043510 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.043488 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fcb5\" (UniqueName: \"kubernetes.io/projected/102160e4-3b43-4655-9beb-2cf422a84bcf-kube-api-access-4fcb5\") pod \"aws-ebs-csi-driver-node-6zfsk\" (UID: \"102160e4-3b43-4655-9beb-2cf422a84bcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.044090 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.044067 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6kgr\" (UniqueName: \"kubernetes.io/projected/4dcb6911-69f1-42b6-8d89-5b8067f71555-kube-api-access-k6kgr\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:19.044652 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.044602 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwhl\" (UniqueName: \"kubernetes.io/projected/0f2e01cb-9153-413b-903e-faec524a75c0-kube-api-access-nmwhl\") pod \"ovnkube-node-rpdwb\" (UID: \"0f2e01cb-9153-413b-903e-faec524a75c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.044652 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.044250 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxxdd\" (UniqueName: \"kubernetes.io/projected/258bd8cd-2ad8-4772-a488-b25587e7dfe5-kube-api-access-zxxdd\") pod \"node-resolver-wpvxt\" (UID: \"258bd8cd-2ad8-4772-a488-b25587e7dfe5\") " pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:19.046085 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.046060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w5l6\" (UniqueName: \"kubernetes.io/projected/362580f4-2da5-46f3-a4de-2a3d6843daec-kube-api-access-9w5l6\") pod \"multus-additional-cni-plugins-52fwn\" (UID: \"362580f4-2da5-46f3-a4de-2a3d6843daec\") " pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.046180 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.046095 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mch6p\" (UniqueName: \"kubernetes.io/projected/6ae0ae01-14ed-441f-8b5c-398297a5183d-kube-api-access-mch6p\") pod \"node-ca-vlcvq\" (UID: \"6ae0ae01-14ed-441f-8b5c-398297a5183d\") " pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:19.050916 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.050777 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" event={"ID":"6a396f40636e367bf35305e84479730c","Type":"ContainerStarted","Data":"16a513f2ab0b12918581f3c1018de4216c3405360e1b286a5310c509818cdf3c"} Jul 24 03:18:19.052668 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.052605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" event={"ID":"b1e568223003c8fbc9f4090069624023","Type":"ContainerStarted","Data":"f0d068cb33f7c627901cec0f2aec074576ba370de0dfebe0d3d510dc692bab81"} Jul 24 03:18:19.128441 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-modprobe-d\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.128617 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysconfig\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.128617 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-systemd\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.128617 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-lib-modules\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.128617 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a10e2dae-e163-47bc-8954-b521f5fa6808-kubelet-config\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.128617 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128559 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-modprobe-d\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.128617 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysconfig\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.128617 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-sys\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128633 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a10e2dae-e163-47bc-8954-b521f5fa6808-kubelet-config\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128647 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-systemd\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-var-lib-kubelet\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128689 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-lib-modules\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-sys\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f829dedf-b461-4aa8-842a-482275797914-host-slash\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128723 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-var-lib-kubelet\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysctl-d\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-kubernetes\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128778 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f829dedf-b461-4aa8-842a-482275797914-host-slash\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.128785 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-host\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-tuned\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128844 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-kubernetes\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128888 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysctl-d\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129036 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.128894 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret podName:a10e2dae-e163-47bc-8954-b521f5fa6808 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:19.628840525 +0000 UTC m=+3.128343849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret") pod "global-pull-secret-syncer-vm9zb" (UID: "a10e2dae-e163-47bc-8954-b521f5fa6808") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-host\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkw6g\" (UniqueName: \"kubernetes.io/projected/3389a1ac-890a-4824-80fe-3085d9c6961b-kube-api-access-kkw6g\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a10e2dae-e163-47bc-8954-b521f5fa6808-dbus\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.128980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysctl-conf\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3389a1ac-890a-4824-80fe-3085d9c6961b-tmp\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/965b976e-9f19-44eb-8762-c8b1a4aec264-konnectivity-ca\") pod \"konnectivity-agent-8vzrn\" (UID: \"965b976e-9f19-44eb-8762-c8b1a4aec264\") " pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5mqc\" (UniqueName: \"kubernetes.io/projected/f829dedf-b461-4aa8-842a-482275797914-kube-api-access-t5mqc\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129112 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a10e2dae-e163-47bc-8954-b521f5fa6808-dbus\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/965b976e-9f19-44eb-8762-c8b1a4aec264-agent-certs\") pod \"konnectivity-agent-8vzrn\" (UID: \"965b976e-9f19-44eb-8762-c8b1a4aec264\") " pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-run\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129219 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f829dedf-b461-4aa8-842a-482275797914-iptables-alerter-script\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129481 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-sysctl-conf\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129549 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3389a1ac-890a-4824-80fe-3085d9c6961b-run\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129694 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/965b976e-9f19-44eb-8762-c8b1a4aec264-konnectivity-ca\") pod \"konnectivity-agent-8vzrn\" (UID: \"965b976e-9f19-44eb-8762-c8b1a4aec264\") " pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:19.129914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.129835 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f829dedf-b461-4aa8-842a-482275797914-iptables-alerter-script\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.132229 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.132150 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3389a1ac-890a-4824-80fe-3085d9c6961b-etc-tuned\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.132374 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.132325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3389a1ac-890a-4824-80fe-3085d9c6961b-tmp\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.132776 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.132696 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/965b976e-9f19-44eb-8762-c8b1a4aec264-agent-certs\") pod \"konnectivity-agent-8vzrn\" (UID: \"965b976e-9f19-44eb-8762-c8b1a4aec264\") " pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:19.140788 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.140726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkw6g\" (UniqueName: \"kubernetes.io/projected/3389a1ac-890a-4824-80fe-3085d9c6961b-kube-api-access-kkw6g\") pod \"tuned-blt2m\" (UID: \"3389a1ac-890a-4824-80fe-3085d9c6961b\") " pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.140788 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.140763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5mqc\" (UniqueName: \"kubernetes.io/projected/f829dedf-b461-4aa8-842a-482275797914-kube-api-access-t5mqc\") pod \"iptables-alerter-ljwxt\" (UID: \"f829dedf-b461-4aa8-842a-482275797914\") " pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.214831 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.214796 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8plts" Jul 24 03:18:19.222426 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.222392 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52fwn" Jul 24 03:18:19.233767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.233737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wpvxt" Jul 24 03:18:19.242434 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.242364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" Jul 24 03:18:19.248468 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.248445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vlcvq" Jul 24 03:18:19.258460 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.258433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:19.272703 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.272676 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ljwxt" Jul 24 03:18:19.281883 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.281861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:19.288796 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.288772 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-blt2m" Jul 24 03:18:19.397358 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.397270 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:18:19.531769 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.531730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:19.531946 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.531914 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:19.531996 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.531984 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs podName:4dcb6911-69f1-42b6-8d89-5b8067f71555 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:20.53196654 +0000 UTC m=+4.031469859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs") pod "network-metrics-daemon-t55cl" (UID: "4dcb6911-69f1-42b6-8d89-5b8067f71555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:19.632890 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.632846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:19.633082 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.632907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:19.633082 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.633038 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:19.633082 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.633061 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:19.633082 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.633079 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:19.633353 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.633093 2564 projected.go:196] Error preparing data for projected volume kube-api-access-l76v5 for pod openshift-network-diagnostics/network-check-target-64mls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:19.633353 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.633116 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret podName:a10e2dae-e163-47bc-8954-b521f5fa6808 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:20.63309258 +0000 UTC m=+4.132595899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret") pod "global-pull-secret-syncer-vm9zb" (UID: "a10e2dae-e163-47bc-8954-b521f5fa6808") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:19.633353 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:19.633148 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5 podName:7acb9d6e-7c72-40b5-a232-9e905d29cdf4 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:20.633130213 +0000 UTC m=+4.132633559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76v5" (UniqueName: "kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5") pod "network-check-target-64mls" (UID: "7acb9d6e-7c72-40b5-a232-9e905d29cdf4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:19.955338 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.955280 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:13:19 +0000 UTC" deadline="2028-02-12 08:11:08.14514156 +0000 UTC" Jul 24 03:18:19.955338 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:19.955327 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13636h52m48.189820266s" Jul 24 03:18:20.260208 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:20.260158 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258bd8cd_2ad8_4772_a488_b25587e7dfe5.slice/crio-730f2b84a279b848b622b350d4703e67c123827ebd5878979ca96a78ba3a1061 WatchSource:0}: Error finding container 730f2b84a279b848b622b350d4703e67c123827ebd5878979ca96a78ba3a1061: Status 404 returned error can't find the container with id 730f2b84a279b848b622b350d4703e67c123827ebd5878979ca96a78ba3a1061 Jul 24 03:18:20.261948 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:20.261883 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2e01cb_9153_413b_903e_faec524a75c0.slice/crio-2481c7b4f04e463e2815a16f0788201c80c4a6370b8624519813bf5649a911dc WatchSource:0}: Error finding container 2481c7b4f04e463e2815a16f0788201c80c4a6370b8624519813bf5649a911dc: Status 404 returned error can't find the container with id 2481c7b4f04e463e2815a16f0788201c80c4a6370b8624519813bf5649a911dc Jul 24 03:18:20.265288 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:20.265227 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965b976e_9f19_44eb_8762_c8b1a4aec264.slice/crio-93b296e9929debf92592808d4f28d737b83f45795a55d2776f804f787b25164b WatchSource:0}: Error finding container 93b296e9929debf92592808d4f28d737b83f45795a55d2776f804f787b25164b: Status 404 returned error can't find the container with id 93b296e9929debf92592808d4f28d737b83f45795a55d2776f804f787b25164b Jul 24 03:18:20.267173 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:20.267149 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287481bf_e7d1_4137_8c14_4ae1f30d6cad.slice/crio-5ab49d7ec375ffc2cf12d8860b5d6da127a63e235684abab8aef9ffd46ec90d3 WatchSource:0}: Error finding container 5ab49d7ec375ffc2cf12d8860b5d6da127a63e235684abab8aef9ffd46ec90d3: Status 404 returned error can't find the container with id 5ab49d7ec375ffc2cf12d8860b5d6da127a63e235684abab8aef9ffd46ec90d3 Jul 24 03:18:20.267956 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:20.267919 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae0ae01_14ed_441f_8b5c_398297a5183d.slice/crio-443101139fe6e05adf1884fe611491738a9c4a6501f31e3f28100358d3932cda WatchSource:0}: Error finding container 443101139fe6e05adf1884fe611491738a9c4a6501f31e3f28100358d3932cda: Status 404 returned error can't find the container with id 443101139fe6e05adf1884fe611491738a9c4a6501f31e3f28100358d3932cda Jul 24 03:18:20.269999 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:20.269975 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102160e4_3b43_4655_9beb_2cf422a84bcf.slice/crio-35e307a5a313029f2b8582bf246b1e69c1fa5aa9ea7ba533d5cd6289a849bc66 WatchSource:0}: Error finding container 35e307a5a313029f2b8582bf246b1e69c1fa5aa9ea7ba533d5cd6289a849bc66: Status 404 returned error can't find the container with id 35e307a5a313029f2b8582bf246b1e69c1fa5aa9ea7ba533d5cd6289a849bc66 Jul 24 03:18:20.271121 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:18:20.271095 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3389a1ac_890a_4824_80fe_3085d9c6961b.slice/crio-d79d6036b637358462d71872068ca0726d0597f9198e0753a4637d0083fc9214 WatchSource:0}: Error finding container d79d6036b637358462d71872068ca0726d0597f9198e0753a4637d0083fc9214: Status 404 returned error can't find the container with id d79d6036b637358462d71872068ca0726d0597f9198e0753a4637d0083fc9214 Jul 24 03:18:20.529102 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:20.529074 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:18:20.539560 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:20.539530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:20.539716 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:20.539653 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:20.539716 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:20.539707 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs podName:4dcb6911-69f1-42b6-8d89-5b8067f71555 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:22.539693421 +0000 UTC m=+6.039196740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs") pod "network-metrics-daemon-t55cl" (UID: "4dcb6911-69f1-42b6-8d89-5b8067f71555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:20.640834 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:20.640796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:20.641014 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:20.640843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:20.641014 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:20.640953 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:20.641108 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:20.641026 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret podName:a10e2dae-e163-47bc-8954-b521f5fa6808 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:22.641008878 +0000 UTC m=+6.140512197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret") pod "global-pull-secret-syncer-vm9zb" (UID: "a10e2dae-e163-47bc-8954-b521f5fa6808") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:20.641108 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:20.640963 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:20.641108 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:20.641063 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:20.641108 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:20.641073 2564 projected.go:196] Error preparing data for projected volume kube-api-access-l76v5 for pod openshift-network-diagnostics/network-check-target-64mls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:20.641233 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:20.641119 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5 podName:7acb9d6e-7c72-40b5-a232-9e905d29cdf4 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:22.641106212 +0000 UTC m=+6.140609532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76v5" (UniqueName: "kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5") pod "network-check-target-64mls" (UID: "7acb9d6e-7c72-40b5-a232-9e905d29cdf4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:20.955898 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:20.955792 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:13:19 +0000 UTC" deadline="2028-01-24 21:42:58.449558353 +0000 UTC" Jul 24 03:18:20.955898 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:20.955862 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13194h24m37.493701911s" Jul 24 03:18:21.048107 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.048074 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:21.048290 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:21.048225 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:21.048670 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.048647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:21.048781 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:21.048753 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:21.048853 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.048829 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:21.048941 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:21.048924 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:21.061568 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.061534 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"2481c7b4f04e463e2815a16f0788201c80c4a6370b8624519813bf5649a911dc"} Jul 24 03:18:21.063402 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.063372 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-blt2m" event={"ID":"3389a1ac-890a-4824-80fe-3085d9c6961b","Type":"ContainerStarted","Data":"d79d6036b637358462d71872068ca0726d0597f9198e0753a4637d0083fc9214"} Jul 24 03:18:21.070090 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.069786 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" event={"ID":"102160e4-3b43-4655-9beb-2cf422a84bcf","Type":"ContainerStarted","Data":"35e307a5a313029f2b8582bf246b1e69c1fa5aa9ea7ba533d5cd6289a849bc66"} Jul 24 03:18:21.077669 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.077579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8plts" event={"ID":"287481bf-e7d1-4137-8c14-4ae1f30d6cad","Type":"ContainerStarted","Data":"5ab49d7ec375ffc2cf12d8860b5d6da127a63e235684abab8aef9ffd46ec90d3"} Jul 24 03:18:21.079660 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.079578 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vzrn" event={"ID":"965b976e-9f19-44eb-8762-c8b1a4aec264","Type":"ContainerStarted","Data":"93b296e9929debf92592808d4f28d737b83f45795a55d2776f804f787b25164b"} Jul 24 03:18:21.082935 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.082910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wpvxt" event={"ID":"258bd8cd-2ad8-4772-a488-b25587e7dfe5","Type":"ContainerStarted","Data":"730f2b84a279b848b622b350d4703e67c123827ebd5878979ca96a78ba3a1061"} Jul 24 03:18:21.098912 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.098875 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" event={"ID":"6a396f40636e367bf35305e84479730c","Type":"ContainerStarted","Data":"7ca7489f73e9f8bae94f69de51eefe55bb91f35c69d69e782b220421e9d3136d"} Jul 24 03:18:21.109953 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.109911 2564 generic.go:356] "Generic (PLEG): container finished" podID="b1e568223003c8fbc9f4090069624023" containerID="7ef6aaf4b46c64d681fa678afaf9e52b023589ad229f81995e84c09b773339f5" exitCode=0 Jul 24 03:18:21.110554 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.110529 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" event={"ID":"b1e568223003c8fbc9f4090069624023","Type":"ContainerDied","Data":"7ef6aaf4b46c64d681fa678afaf9e52b023589ad229f81995e84c09b773339f5"} Jul 24 03:18:21.114095 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.114067 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ljwxt" event={"ID":"f829dedf-b461-4aa8-842a-482275797914","Type":"ContainerStarted","Data":"1648d6385ad7d6e49bad1069727cf7fed08a3a57e970370a1a5fa73b2d81a36a"} Jul 24 03:18:21.118522 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.118191 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerStarted","Data":"1caf61ce349b34ec026b75d27a7c36b3a8fe4245ca8394b6a73dc3121065549c"} Jul 24 03:18:21.132141 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.132029 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-231.ec2.internal" podStartSLOduration=2.132006768 podStartE2EDuration="2.132006768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:21.116355803 +0000 UTC m=+4.615859147" watchObservedRunningTime="2026-07-24 03:18:21.132006768 +0000 UTC m=+4.631510113" Jul 24 03:18:21.135243 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:21.135212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vlcvq" event={"ID":"6ae0ae01-14ed-441f-8b5c-398297a5183d","Type":"ContainerStarted","Data":"443101139fe6e05adf1884fe611491738a9c4a6501f31e3f28100358d3932cda"} Jul 24 03:18:22.151356 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:22.151269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" event={"ID":"b1e568223003c8fbc9f4090069624023","Type":"ContainerStarted","Data":"150de32e7676a97ec2e8b6c841c2c93c54643efd765ace96f2f56e35a5b083e4"} Jul 24 03:18:22.563798 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:22.563692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:22.563970 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:22.563930 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:22.564045 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:22.564005 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs podName:4dcb6911-69f1-42b6-8d89-5b8067f71555 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:26.563980837 +0000 UTC m=+10.063484164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs") pod "network-metrics-daemon-t55cl" (UID: "4dcb6911-69f1-42b6-8d89-5b8067f71555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:22.664538 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:22.664492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:22.664718 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:22.664597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:22.664777 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:22.664732 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:22.664830 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:22.664800 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret podName:a10e2dae-e163-47bc-8954-b521f5fa6808 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:26.664780837 +0000 UTC m=+10.164284162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret") pod "global-pull-secret-syncer-vm9zb" (UID: "a10e2dae-e163-47bc-8954-b521f5fa6808") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:22.665256 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:22.665237 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:22.665331 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:22.665263 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:22.665331 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:22.665279 2564 projected.go:196] Error preparing data for projected volume kube-api-access-l76v5 for pod openshift-network-diagnostics/network-check-target-64mls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:22.665476 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:22.665331 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5 podName:7acb9d6e-7c72-40b5-a232-9e905d29cdf4 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:26.665314209 +0000 UTC m=+10.164817533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76v5" (UniqueName: "kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5") pod "network-check-target-64mls" (UID: "7acb9d6e-7c72-40b5-a232-9e905d29cdf4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:23.047770 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:23.047683 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:23.047958 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:23.047826 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:23.048446 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:23.048425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:23.048552 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:23.048531 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:23.048630 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:23.048607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:23.048715 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:23.048694 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:25.047172 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:25.044723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:25.047172 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:25.044747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:25.047172 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:25.044857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:25.047172 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:25.044876 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:25.047172 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:25.045006 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:25.047172 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:25.045093 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:26.601910 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:26.601867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:26.602428 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:26.602049 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:26.602428 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:26.602115 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs podName:4dcb6911-69f1-42b6-8d89-5b8067f71555 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:34.602095447 +0000 UTC m=+18.101598769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs") pod "network-metrics-daemon-t55cl" (UID: "4dcb6911-69f1-42b6-8d89-5b8067f71555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:26.702599 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:26.702560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:26.702791 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:26.702656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:26.702791 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:26.702776 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:26.702901 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:26.702802 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:26.702901 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:26.702828 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:26.702901 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:26.702839 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret podName:a10e2dae-e163-47bc-8954-b521f5fa6808 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:34.702818601 +0000 UTC m=+18.202321927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret") pod "global-pull-secret-syncer-vm9zb" (UID: "a10e2dae-e163-47bc-8954-b521f5fa6808") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:26.702901 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:26.702842 2564 projected.go:196] Error preparing data for projected volume kube-api-access-l76v5 for pod openshift-network-diagnostics/network-check-target-64mls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:26.702901 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:26.702900 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5 podName:7acb9d6e-7c72-40b5-a232-9e905d29cdf4 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:34.702882868 +0000 UTC m=+18.202386192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76v5" (UniqueName: "kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5") pod "network-check-target-64mls" (UID: "7acb9d6e-7c72-40b5-a232-9e905d29cdf4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:27.047238 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:27.046186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:27.047238 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:27.046348 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:27.047238 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:27.046866 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:27.047238 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:27.046988 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:27.047238 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:27.047049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:27.047238 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:27.047122 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:29.046410 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:29.046005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:29.046410 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:29.046042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:29.046410 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:29.046141 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:29.046410 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:29.046005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:29.046410 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:29.046241 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:29.046410 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:29.046324 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:31.045095 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:31.045057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:31.045585 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:31.045247 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:31.045585 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:31.045100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:31.045585 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:31.045369 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:31.045585 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:31.045069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:31.045585 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:31.045459 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:33.044715 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:33.044664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:33.045147 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:33.044718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:33.045147 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:33.044664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:33.045147 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:33.044806 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:33.045147 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:33.044906 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:33.045147 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:33.044991 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:34.662890 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:34.662854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:34.663392 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:34.662991 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:34.663392 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:34.663057 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs podName:4dcb6911-69f1-42b6-8d89-5b8067f71555 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:50.663037051 +0000 UTC m=+34.162540392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs") pod "network-metrics-daemon-t55cl" (UID: "4dcb6911-69f1-42b6-8d89-5b8067f71555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:34.764163 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:34.764115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:34.764347 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:34.764174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:34.764347 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:34.764289 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:34.764463 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:34.764372 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret podName:a10e2dae-e163-47bc-8954-b521f5fa6808 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:50.764352999 +0000 UTC m=+34.263856364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret") pod "global-pull-secret-syncer-vm9zb" (UID: "a10e2dae-e163-47bc-8954-b521f5fa6808") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:34.764463 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:34.764288 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:34.764463 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:34.764411 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:34.764463 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:34.764426 2564 projected.go:196] Error preparing data for projected volume kube-api-access-l76v5 for pod openshift-network-diagnostics/network-check-target-64mls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:34.764642 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:34.764476 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5 podName:7acb9d6e-7c72-40b5-a232-9e905d29cdf4 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:50.76446152 +0000 UTC m=+34.263964839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76v5" (UniqueName: "kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5") pod "network-check-target-64mls" (UID: "7acb9d6e-7c72-40b5-a232-9e905d29cdf4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:35.044789 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:35.044695 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:35.044789 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:35.044727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:35.045002 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:35.044703 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:35.045002 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:35.044815 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:35.045002 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:35.044922 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:35.045187 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:35.045020 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:37.046154 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:37.046123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:37.046642 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:37.046222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:37.046642 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:37.046227 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:37.046642 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:37.046365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:37.046642 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:37.046362 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:37.046642 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:37.046440 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:39.045026 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:39.044989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:39.045484 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:39.044989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:39.045484 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:39.045121 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:39.045484 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:39.045000 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:39.045484 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:39.045220 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:39.045484 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:39.045254 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:40.197869 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.197415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wpvxt" event={"ID":"258bd8cd-2ad8-4772-a488-b25587e7dfe5","Type":"ContainerStarted","Data":"e0fb871ff6a69722fdff302467bfe214640b2c9d8df32abb55348288ce648487"} Jul 24 03:18:40.199091 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.199068 2564 generic.go:356] "Generic (PLEG): container finished" podID="362580f4-2da5-46f3-a4de-2a3d6843daec" containerID="85e0182a8bef078fbec18b01ed95a04021c46f785281e85cb9c3159252265033" exitCode=0 Jul 24 03:18:40.199204 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.199138 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerDied","Data":"85e0182a8bef078fbec18b01ed95a04021c46f785281e85cb9c3159252265033"} Jul 24 03:18:40.202357 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.200926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vlcvq" event={"ID":"6ae0ae01-14ed-441f-8b5c-398297a5183d","Type":"ContainerStarted","Data":"3dccd9cfbb29ecf030af0919b0c422c002754730006e764c2f74a235a752c324"} Jul 24 03:18:40.206277 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.206249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"9148bbe64bb9fe48712c37ebc15330ecc2697d48e2de74377a1639c8ebcde7d6"} Jul 24 03:18:40.206379 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.206349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"abf7d70535d5f70b8be4186c6ecebf02a226e74b5866105687f2da0192c6d702"} Jul 24 03:18:40.206419 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.206398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"b611183acb3522a90d096b0bf6dbe168a162e433abad9b5f9d8d66c9a0a05e90"} Jul 24 03:18:40.206472 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.206442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"db6ce6d3d472b48a521995d9f4d8393e4668f80c045f4f1ad128ff08969b25df"} Jul 24 03:18:40.206508 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.206486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"e5c98ce02041cc1c923e4826f0a526e3af45c1600c3a3596df0c5b1af8e035b1"} Jul 24 03:18:40.206548 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.206530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"1adc7d4317667d2a5e14a2ffc2264d56839f524a79ccd7ea2070861d4f840063"} Jul 24 03:18:40.207599 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.207581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-blt2m" event={"ID":"3389a1ac-890a-4824-80fe-3085d9c6961b","Type":"ContainerStarted","Data":"22b20bdfbd57fed5bf9acb6ecaf576fc710a866e98731443e8b04a287584b9f8"} Jul 24 03:18:40.208954 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.208933 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" event={"ID":"102160e4-3b43-4655-9beb-2cf422a84bcf","Type":"ContainerStarted","Data":"c23f9f9a3dc56baf3cbcf6fddd611fc0feed4b99b3c25e19e816c3546abb6dcc"} Jul 24 03:18:40.210264 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.210246 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8plts" event={"ID":"287481bf-e7d1-4137-8c14-4ae1f30d6cad","Type":"ContainerStarted","Data":"082a00d8c757eab45ac3b71285892de9bf9b9d6c44665f6b8b806dd933bb01a4"} Jul 24 03:18:40.211557 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.211536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vzrn" event={"ID":"965b976e-9f19-44eb-8762-c8b1a4aec264","Type":"ContainerStarted","Data":"7dc23b3ea10bd660a11064a4f9a1087a192c86fbcf98361607fe764ff1265a2e"} Jul 24 03:18:40.212538 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.212496 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wpvxt" podStartSLOduration=4.097915955 podStartE2EDuration="23.212484361s" totalImagesPullingTime="19.114568406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:40.212014758 +0000 UTC m=+23.711518097" watchObservedRunningTime="2026-07-24 03:18:40.212484361 +0000 UTC m=+23.711987700" Jul 24 03:18:40.212643 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.212584 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-231.ec2.internal" podStartSLOduration=21.212577011 podStartE2EDuration="21.212577011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:22.179613186 +0000 UTC m=+5.679116534" watchObservedRunningTime="2026-07-24 03:18:40.212577011 +0000 UTC m=+23.712080353" Jul 24 03:18:40.229287 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.229241 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8plts" podStartSLOduration=4.055756708 podStartE2EDuration="23.229226987s" totalImagesPullingTime="19.173470279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:40.228824379 +0000 UTC m=+23.728327732" watchObservedRunningTime="2026-07-24 03:18:40.229226987 +0000 UTC m=+23.728730353" Jul 24 03:18:40.265690 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.265632 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vlcvq" podStartSLOduration=3.166220856 podStartE2EDuration="22.265614414s" totalImagesPullingTime="19.099393558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:40.265589111 +0000 UTC m=+23.765092471" watchObservedRunningTime="2026-07-24 03:18:40.265614414 +0000 UTC m=+23.765117732" Jul 24 03:18:40.284164 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.284114 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8vzrn" podStartSLOduration=3.206860453 podStartE2EDuration="22.284096731s" totalImagesPullingTime="19.077236278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:40.283640198 +0000 UTC m=+23.783143538" watchObservedRunningTime="2026-07-24 03:18:40.284096731 +0000 UTC m=+23.783600070" Jul 24 03:18:40.304306 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.304250 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-blt2m" podStartSLOduration=3.196811685 podStartE2EDuration="22.304232758s" totalImagesPullingTime="19.107421073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:40.303858171 +0000 UTC m=+23.803361512" watchObservedRunningTime="2026-07-24 03:18:40.304232758 +0000 UTC m=+23.803736147" Jul 24 03:18:40.373515 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.373484 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:40.449331 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.449242 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:40.728215 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.728189 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 03:18:40.891358 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.891321 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:40.993939 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.993751 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T03:18:40.728209761Z","UUID":"dcea48b9-bde1-451b-a758-936fb253efc2","Handler":null,"Name":"","Endpoint":""} Jul 24 03:18:40.995392 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.995363 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 03:18:40.995525 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.995415 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 03:18:40.998373 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:40.998341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:41.045393 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:41.045358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:41.045565 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:41.045358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:41.045565 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:41.045488 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:41.045565 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:41.045485 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:41.045808 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:41.045575 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:41.045808 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:41.045651 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:41.214982 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:41.214945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ljwxt" event={"ID":"f829dedf-b461-4aa8-842a-482275797914","Type":"ContainerStarted","Data":"8574045f73619bf867903ffc9b206cfa5eb609f5890999b58e36a7c2b0fe47e9"} Jul 24 03:18:41.216962 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:41.216935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" event={"ID":"102160e4-3b43-4655-9beb-2cf422a84bcf","Type":"ContainerStarted","Data":"6b73881477613a3293c1e44e41f41b3764bb7303065874bd7f4fe90052026a17"} Jul 24 03:18:41.234872 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:41.234819 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ljwxt" podStartSLOduration=4.146485437 podStartE2EDuration="23.234802397s" totalImagesPullingTime="19.08831696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:41.23458659 +0000 UTC m=+24.734089934" watchObservedRunningTime="2026-07-24 03:18:41.234802397 +0000 UTC m=+24.734305738" Jul 24 03:18:41.260278 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:41.260196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:41.358958 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:41.358924 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:42.085810 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:42.085778 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:42.223678 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:42.223524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"cc8fec5c551163ce251569cc4b850b5c1d0a5e54649acb9d73b84abaf22b41e4"} Jul 24 03:18:42.226388 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:42.226358 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" event={"ID":"102160e4-3b43-4655-9beb-2cf422a84bcf","Type":"ContainerStarted","Data":"6f3ed5dc7fc1fdbd4ecc2495b9a263795f4148b5b0ebcce4563b852a1e6ae5e8"} Jul 24 03:18:42.248189 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:42.248132 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6zfsk" podStartSLOduration=2.912169553 podStartE2EDuration="24.248111016s" totalImagesPullingTime="21.335941463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:42.247987468 +0000 UTC m=+25.747490858" watchObservedRunningTime="2026-07-24 03:18:42.248111016 +0000 UTC m=+25.747614355" Jul 24 03:18:42.497533 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:42.497445 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:42.569653 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:42.569623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:42.849448 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:42.849418 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:43.044744 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.044570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:43.044912 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.044674 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:43.044912 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:43.044830 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:43.044912 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.044686 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:43.045060 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:43.044927 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:43.045060 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:43.045002 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:43.685579 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.685540 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:43.708379 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.708344 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:43.709026 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.709002 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:43.783322 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.783273 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:43.846506 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.846481 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wpvxt_258bd8cd-2ad8-4772-a488-b25587e7dfe5/dns-node-resolver/0.log" Jul 24 03:18:43.848362 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.848339 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:43.908210 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:43.908177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:44.099819 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:44.099757 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:44.401790 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:44.401758 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:44.500397 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:44.500369 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:44.636753 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:44.636679 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:44.637235 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:44.637203 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8vzrn" Jul 24 03:18:44.695677 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:44.695643 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:44.850711 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:44.850529 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vlcvq_6ae0ae01-14ed-441f-8b5c-398297a5183d/node-ca/0.log" Jul 24 03:18:45.044723 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:45.044637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:45.044723 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:45.044664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:45.044908 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:45.044640 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:45.044908 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:45.044745 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:45.044908 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:45.044859 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:45.045034 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:45.044937 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:45.234169 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:45.234130 2564 generic.go:356] "Generic (PLEG): container finished" podID="362580f4-2da5-46f3-a4de-2a3d6843daec" containerID="6fea8ca469679ce6bb87114e976b314aa64559dc49b77901a6995542c0925994" exitCode=0 Jul 24 03:18:45.234343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:45.234209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerDied","Data":"6fea8ca469679ce6bb87114e976b314aa64559dc49b77901a6995542c0925994"} Jul 24 03:18:45.238106 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:45.238081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" event={"ID":"0f2e01cb-9153-413b-903e-faec524a75c0","Type":"ContainerStarted","Data":"8ca55458a79f34d91ca61493db7563be280c912ecda8e0e933d9340eac0b128c"} Jul 24 03:18:45.238286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:45.238270 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:45.278586 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:45.278538 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" podStartSLOduration=8.104460111 podStartE2EDuration="27.278522108s" totalImagesPullingTime="19.174061997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:45.277189745 +0000 UTC m=+28.776693117" watchObservedRunningTime="2026-07-24 03:18:45.278522108 +0000 UTC m=+28.778025447" Jul 24 03:18:46.020983 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.020946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:46.242276 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.242233 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerStarted","Data":"3e364df2fb1cf6f761b4fa3aef2b5ca550db30aca7c820dba9b7ea44ae4e9c8b"} Jul 24 03:18:46.243002 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.242978 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:46.243121 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.243062 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:46.257333 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.257289 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:46.257479 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.257407 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:18:46.293992 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.293868 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64mls"] Jul 24 03:18:46.293992 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.293997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:46.294212 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:46.294127 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:46.294515 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.294493 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t55cl"] Jul 24 03:18:46.294599 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.294592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:46.294695 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:46.294679 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:46.304327 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.304280 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vm9zb"] Jul 24 03:18:46.304447 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.304392 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:46.304491 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:46.304473 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:46.367113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.367083 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:46.456688 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.456656 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:46.920715 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:46.920680 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:47.245912 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:47.245831 2564 generic.go:356] "Generic (PLEG): container finished" podID="362580f4-2da5-46f3-a4de-2a3d6843daec" containerID="3e364df2fb1cf6f761b4fa3aef2b5ca550db30aca7c820dba9b7ea44ae4e9c8b" exitCode=0 Jul 24 03:18:47.246250 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:47.245916 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerDied","Data":"3e364df2fb1cf6f761b4fa3aef2b5ca550db30aca7c820dba9b7ea44ae4e9c8b"} Jul 24 03:18:47.818462 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:47.818432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:48.045404 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:48.045370 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:48.045404 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:48.045401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:48.045646 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:48.045406 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:48.045646 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:48.045467 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:48.045646 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:48.045583 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:48.045779 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:48.045688 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:48.736047 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:48.735855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:48.836540 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:48.836504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:48.958279 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:48.958239 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:49.056510 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:49.056438 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:49.212830 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:49.212797 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:49.254752 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:49.254720 2564 generic.go:356] "Generic (PLEG): container finished" podID="362580f4-2da5-46f3-a4de-2a3d6843daec" containerID="25dba4a52694dcb7856da188a88eb4a0e43c1b4db43d65d80b3bfb82d10f6266" exitCode=0 Jul 24 03:18:49.254909 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:49.254782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerDied","Data":"25dba4a52694dcb7856da188a88eb4a0e43c1b4db43d65d80b3bfb82d10f6266"} Jul 24 03:18:49.428957 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:49.428924 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:49.974626 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:49.974568 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:50.044654 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:50.044623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:50.044827 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:50.044730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:50.044873 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.044831 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:50.044873 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.044729 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:50.044873 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:50.044724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:50.044979 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.044912 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:50.071879 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:50.071842 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:50.677692 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:50.677650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:50.677893 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.677822 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:50.677965 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.677901 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs podName:4dcb6911-69f1-42b6-8d89-5b8067f71555 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:22.677878815 +0000 UTC m=+66.177382135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs") pod "network-metrics-daemon-t55cl" (UID: "4dcb6911-69f1-42b6-8d89-5b8067f71555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:50.778348 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:50.778315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:50.778522 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:50.778384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:50.778522 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.778489 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:50.778522 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.778492 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:50.778522 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.778512 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:50.778522 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.778522 2564 projected.go:196] Error preparing data for projected volume kube-api-access-l76v5 for pod openshift-network-diagnostics/network-check-target-64mls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:50.778703 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.778541 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret podName:a10e2dae-e163-47bc-8954-b521f5fa6808 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:22.778527974 +0000 UTC m=+66.278031295 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret") pod "global-pull-secret-syncer-vm9zb" (UID: "a10e2dae-e163-47bc-8954-b521f5fa6808") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:50.778703 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:50.778563 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5 podName:7acb9d6e-7c72-40b5-a232-9e905d29cdf4 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:22.77854995 +0000 UTC m=+66.278053268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76v5" (UniqueName: "kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5") pod "network-check-target-64mls" (UID: "7acb9d6e-7c72-40b5-a232-9e905d29cdf4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:50.859518 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:50.859436 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:51.034467 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:51.034432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:51.087757 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:51.087723 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:51.466749 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:51.466717 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:51.638308 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:51.638259 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:52.025498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:52.025470 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:52.044856 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:52.044832 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:52.044856 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:52.044866 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:52.045868 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:52.045000 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:52.045868 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:52.045053 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:52.045868 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:52.045050 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:52.045868 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:52.045130 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:52.126380 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:52.126328 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:52.344551 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:52.344519 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:52.833905 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:52.833867 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:53.189195 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:53.189095 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:53.287135 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:53.287103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:53.341772 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:53.341743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:53.426072 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:53.426018 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:53.625723 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:53.625689 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:53.840424 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:53.840384 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:54.045215 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:54.045146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:54.045215 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:54.045190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:54.045402 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:54.045149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:54.045402 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:54.045260 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:54.045402 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:54.045342 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:54.045492 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:54.045437 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:54.267002 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:54.266968 2564 generic.go:356] "Generic (PLEG): container finished" podID="362580f4-2da5-46f3-a4de-2a3d6843daec" containerID="821efc2d3c2d4d63322d5ef2fbe86d0154e0b7768a5261d41b159dee823b734a" exitCode=0 Jul 24 03:18:54.267464 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:54.267015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerDied","Data":"821efc2d3c2d4d63322d5ef2fbe86d0154e0b7768a5261d41b159dee823b734a"} Jul 24 03:18:55.028787 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:55.028751 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:55.227923 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:55.227897 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:55.272039 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:55.272008 2564 generic.go:356] "Generic (PLEG): container finished" podID="362580f4-2da5-46f3-a4de-2a3d6843daec" containerID="34ff1324d8a8aafc78ae8da07b96689daa821ddda74b49c752696a57064b38b6" exitCode=0 Jul 24 03:18:55.272618 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:55.272066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerDied","Data":"34ff1324d8a8aafc78ae8da07b96689daa821ddda74b49c752696a57064b38b6"} Jul 24 03:18:55.428038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:55.428005 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:55.617572 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:55.617539 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:55.677115 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:55.677079 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:55.825478 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:55.825449 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:56.045416 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:56.045335 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:56.045561 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:56.045335 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:56.045561 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:56.045449 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:56.045561 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:56.045526 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:56.045561 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:56.045335 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:56.045714 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:56.045589 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:56.277863 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:56.277674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52fwn" event={"ID":"362580f4-2da5-46f3-a4de-2a3d6843daec","Type":"ContainerStarted","Data":"075d37ea38343be8c9d33073a264ae5eb7b66286d2bcead826f8a80faa6c459b"} Jul 24 03:18:56.303188 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:56.303093 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-52fwn" podStartSLOduration=9.316725795 podStartE2EDuration="39.303076354s" totalImagesPullingTime="29.986350559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:56.30277706 +0000 UTC m=+39.802280402" watchObservedRunningTime="2026-07-24 03:18:56.303076354 +0000 UTC m=+39.802579694" Jul 24 03:18:56.626429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:56.626400 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:57.032472 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:57.032342 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:57.231313 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:57.231266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:57.662263 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:57.662234 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:57.762880 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:57.762846 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:57.837114 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:57.837081 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:58.044692 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:58.044608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:18:58.044692 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:58.044641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:18:58.044692 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:58.044649 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:18:58.044888 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:58.044732 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:18:58.044888 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:58.044808 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:18:58.044958 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:18:58.044876 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:18:58.229536 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:58.229504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:58.427133 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:58.427105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:58.827205 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:58.827176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:59.225611 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:59.225517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:59.426968 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:18:59.426939 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:00.045230 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:00.045200 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:00.045640 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:00.045347 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:19:00.045640 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:00.045373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:19:00.045640 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:00.045385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:19:00.045640 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:00.045458 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:19:00.045640 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:00.045522 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:19:02.044823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:02.044785 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:19:02.045403 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:02.044788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:19:02.045403 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:02.044906 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:19:02.045403 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:02.044788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:02.045403 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:02.044977 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:19:02.045403 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:02.045029 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:19:04.045227 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:04.045192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:19:04.045620 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:04.045197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:19:04.045620 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:04.045197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:04.045620 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:04.045307 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:19:04.045620 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:04.045481 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:19:04.045620 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:04.045398 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:19:06.045161 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:06.045120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:19:06.045161 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:06.045163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:19:06.045611 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:06.045247 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm9zb" podUID="a10e2dae-e163-47bc-8954-b521f5fa6808" Jul 24 03:19:06.045611 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:06.045286 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t55cl" podUID="4dcb6911-69f1-42b6-8d89-5b8067f71555" Jul 24 03:19:06.045611 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:06.045339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:06.045611 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:06.045423 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64mls" podUID="7acb9d6e-7c72-40b5-a232-9e905d29cdf4" Jul 24 03:19:06.819544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:06.819504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:06.914516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:06.914487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:07.014534 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.014503 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:07.114069 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.113983 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:07.267611 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.267587 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-231.ec2.internal" event="NodeReady" Jul 24 03:19:07.267783 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.267711 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 03:19:07.305275 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.305241 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d86b496cc-rhvn4"] Jul 24 03:19:07.315811 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.315781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.319339 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.319321 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 03:19:07.319546 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.319532 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 03:19:07.319858 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.319842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 03:19:07.320342 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.320323 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-frvz7\"" Jul 24 03:19:07.328121 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.328084 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d86b496cc-rhvn4"] Jul 24 03:19:07.328285 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.328269 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 03:19:07.330088 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.330055 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xc7cz"] Jul 24 03:19:07.341674 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.341650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xc7cz" Jul 24 03:19:07.344189 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.344161 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xc7cz"] Jul 24 03:19:07.345886 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.345867 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 03:19:07.346051 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.345876 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 03:19:07.346618 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.346596 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mnmfg\"" Jul 24 03:19:07.346787 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.346771 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 03:19:07.351042 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.351023 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbrmz"] Jul 24 03:19:07.362223 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.362201 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.364697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.364622 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbrmz"] Jul 24 03:19:07.365350 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.365329 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 03:19:07.365457 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.365362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmhzr\"" Jul 24 03:19:07.365518 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.365458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 03:19:07.365518 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.365490 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 03:19:07.365613 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.365585 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 03:19:07.406619 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9576d128-6a3e-496f-80be-f23c5de57319-ca-trust-extracted\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.406619 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa8a88e-64d9-47be-9329-2adcf06f09bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.406833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90791e7e-1c44-4ce4-ab9b-89d7f552e444-cert\") pod \"ingress-canary-xc7cz\" (UID: \"90791e7e-1c44-4ce4-ab9b-89d7f552e444\") " pod="openshift-ingress-canary/ingress-canary-xc7cz" Jul 24 03:19:07.406833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr4v2\" (UniqueName: \"kubernetes.io/projected/90791e7e-1c44-4ce4-ab9b-89d7f552e444-kube-api-access-nr4v2\") pod \"ingress-canary-xc7cz\" (UID: \"90791e7e-1c44-4ce4-ab9b-89d7f552e444\") " pod="openshift-ingress-canary/ingress-canary-xc7cz" Jul 24 03:19:07.406833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tppgs\" (UniqueName: \"kubernetes.io/projected/eaa8a88e-64d9-47be-9329-2adcf06f09bc-kube-api-access-tppgs\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.406833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-bound-sa-token\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.406833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9576d128-6a3e-496f-80be-f23c5de57319-trusted-ca\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.406833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw7n9\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-kube-api-access-qw7n9\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.406833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa8a88e-64d9-47be-9329-2adcf06f09bc-crio-socket\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.407073 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9576d128-6a3e-496f-80be-f23c5de57319-image-registry-private-configuration\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.407073 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-registry-tls\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.407073 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9576d128-6a3e-496f-80be-f23c5de57319-registry-certificates\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.407073 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406957 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9576d128-6a3e-496f-80be-f23c5de57319-installation-pull-secrets\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.407073 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa8a88e-64d9-47be-9329-2adcf06f09bc-data-volume\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.407073 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.406998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa8a88e-64d9-47be-9329-2adcf06f09bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.435573 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.435542 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmfpq"] Jul 24 03:19:07.449326 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.449279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.452436 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.452409 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmfpq"] Jul 24 03:19:07.452578 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.452444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 03:19:07.452578 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.452531 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gd8s9\"" Jul 24 03:19:07.452578 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.452565 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 03:19:07.507915 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.507879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-bound-sa-token\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.507915 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.507930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9576d128-6a3e-496f-80be-f23c5de57319-trusted-ca\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.508155 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.507957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw7n9\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-kube-api-access-qw7n9\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.508155 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa8a88e-64d9-47be-9329-2adcf06f09bc-crio-socket\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.508155 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9576d128-6a3e-496f-80be-f23c5de57319-image-registry-private-configuration\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.508155 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-registry-tls\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.508155 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9576d128-6a3e-496f-80be-f23c5de57319-registry-certificates\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.508155 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508108 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa8a88e-64d9-47be-9329-2adcf06f09bc-crio-socket\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9576d128-6a3e-496f-80be-f23c5de57319-installation-pull-secrets\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa8a88e-64d9-47be-9329-2adcf06f09bc-data-volume\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa8a88e-64d9-47be-9329-2adcf06f09bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9576d128-6a3e-496f-80be-f23c5de57319-ca-trust-extracted\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d32d592c-d230-4a4a-9fd1-980647cf692e-tmp-dir\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa8a88e-64d9-47be-9329-2adcf06f09bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d32d592c-d230-4a4a-9fd1-980647cf692e-metrics-tls\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wgr6\" (UniqueName: \"kubernetes.io/projected/d32d592c-d230-4a4a-9fd1-980647cf692e-kube-api-access-4wgr6\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d32d592c-d230-4a4a-9fd1-980647cf692e-config-volume\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.508473 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90791e7e-1c44-4ce4-ab9b-89d7f552e444-cert\") pod \"ingress-canary-xc7cz\" (UID: \"90791e7e-1c44-4ce4-ab9b-89d7f552e444\") " pod="openshift-ingress-canary/ingress-canary-xc7cz" Jul 24 03:19:07.508921 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr4v2\" (UniqueName: \"kubernetes.io/projected/90791e7e-1c44-4ce4-ab9b-89d7f552e444-kube-api-access-nr4v2\") pod \"ingress-canary-xc7cz\" (UID: \"90791e7e-1c44-4ce4-ab9b-89d7f552e444\") " pod="openshift-ingress-canary/ingress-canary-xc7cz" Jul 24 03:19:07.508921 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tppgs\" (UniqueName: \"kubernetes.io/projected/eaa8a88e-64d9-47be-9329-2adcf06f09bc-kube-api-access-tppgs\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.508921 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508549 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa8a88e-64d9-47be-9329-2adcf06f09bc-data-volume\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.508921 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508852 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9576d128-6a3e-496f-80be-f23c5de57319-ca-trust-extracted\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.509118 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.508991 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9576d128-6a3e-496f-80be-f23c5de57319-trusted-ca\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.509118 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.509043 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9576d128-6a3e-496f-80be-f23c5de57319-registry-certificates\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.509340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.509318 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa8a88e-64d9-47be-9329-2adcf06f09bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.512470 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.512445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa8a88e-64d9-47be-9329-2adcf06f09bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.512587 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.512501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9576d128-6a3e-496f-80be-f23c5de57319-installation-pull-secrets\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.512587 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.512520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9576d128-6a3e-496f-80be-f23c5de57319-image-registry-private-configuration\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.512587 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.512565 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90791e7e-1c44-4ce4-ab9b-89d7f552e444-cert\") pod \"ingress-canary-xc7cz\" (UID: \"90791e7e-1c44-4ce4-ab9b-89d7f552e444\") " pod="openshift-ingress-canary/ingress-canary-xc7cz" Jul 24 03:19:07.512747 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.512597 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-registry-tls\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.516994 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.516968 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-bound-sa-token\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.517084 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.516997 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tppgs\" (UniqueName: \"kubernetes.io/projected/eaa8a88e-64d9-47be-9329-2adcf06f09bc-kube-api-access-tppgs\") pod \"insights-runtime-extractor-fbrmz\" (UID: \"eaa8a88e-64d9-47be-9329-2adcf06f09bc\") " pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.517084 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.517014 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr4v2\" (UniqueName: \"kubernetes.io/projected/90791e7e-1c44-4ce4-ab9b-89d7f552e444-kube-api-access-nr4v2\") pod \"ingress-canary-xc7cz\" (UID: \"90791e7e-1c44-4ce4-ab9b-89d7f552e444\") " pod="openshift-ingress-canary/ingress-canary-xc7cz" Jul 24 03:19:07.517583 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.517563 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw7n9\" (UniqueName: \"kubernetes.io/projected/9576d128-6a3e-496f-80be-f23c5de57319-kube-api-access-qw7n9\") pod \"image-registry-5d86b496cc-rhvn4\" (UID: \"9576d128-6a3e-496f-80be-f23c5de57319\") " pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.536088 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.536063 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:07.609171 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.609135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d32d592c-d230-4a4a-9fd1-980647cf692e-tmp-dir\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.609171 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.609177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d32d592c-d230-4a4a-9fd1-980647cf692e-metrics-tls\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.609386 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.609199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wgr6\" (UniqueName: \"kubernetes.io/projected/d32d592c-d230-4a4a-9fd1-980647cf692e-kube-api-access-4wgr6\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.609386 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.609343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d32d592c-d230-4a4a-9fd1-980647cf692e-config-volume\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.609577 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.609558 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d32d592c-d230-4a4a-9fd1-980647cf692e-tmp-dir\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.609861 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.609839 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d32d592c-d230-4a4a-9fd1-980647cf692e-config-volume\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.611556 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.611538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d32d592c-d230-4a4a-9fd1-980647cf692e-metrics-tls\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.617106 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.617055 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wgr6\" (UniqueName: \"kubernetes.io/projected/d32d592c-d230-4a4a-9fd1-980647cf692e-kube-api-access-4wgr6\") pod \"dns-default-hmfpq\" (UID: \"d32d592c-d230-4a4a-9fd1-980647cf692e\") " pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.624934 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.624912 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:07.637348 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.637285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:07.651179 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.651159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xc7cz" Jul 24 03:19:07.671050 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.671025 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbrmz" Jul 24 03:19:07.761748 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.761182 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:07.832257 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.832185 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xc7cz"] Jul 24 03:19:07.852729 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.851810 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d86b496cc-rhvn4"] Jul 24 03:19:07.854403 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:07.854370 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9576d128_6a3e_496f_80be_f23c5de57319.slice/crio-d53f06e96ad5886b1c5b2e4977052117530b151035ea7e3fac7f688da16ad0ee WatchSource:0}: Error finding container d53f06e96ad5886b1c5b2e4977052117530b151035ea7e3fac7f688da16ad0ee: Status 404 returned error can't find the container with id d53f06e96ad5886b1c5b2e4977052117530b151035ea7e3fac7f688da16ad0ee Jul 24 03:19:07.869633 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.869586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbrmz"] Jul 24 03:19:07.873227 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:07.873205 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa8a88e_64d9_47be_9329_2adcf06f09bc.slice/crio-2924288ecfad44eb3801caa4f62a7420bcf3a46b157626698d693864ae695c77 WatchSource:0}: Error finding container 2924288ecfad44eb3801caa4f62a7420bcf3a46b157626698d693864ae695c77: Status 404 returned error can't find the container with id 2924288ecfad44eb3801caa4f62a7420bcf3a46b157626698d693864ae695c77 Jul 24 03:19:07.928281 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:07.928254 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmfpq"] Jul 24 03:19:07.931591 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:07.931565 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32d592c_d230_4a4a_9fd1_980647cf692e.slice/crio-8e6663db59b4d17f35330475e783f7f59661e167327dfdd4cbc6cc4068f07bde WatchSource:0}: Error finding container 8e6663db59b4d17f35330475e783f7f59661e167327dfdd4cbc6cc4068f07bde: Status 404 returned error can't find the container with id 8e6663db59b4d17f35330475e783f7f59661e167327dfdd4cbc6cc4068f07bde Jul 24 03:19:08.045070 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.045039 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:19:08.045202 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.045075 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:08.045202 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.045051 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:19:08.047929 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.047904 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ph9hg\"" Jul 24 03:19:08.048060 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.047947 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 03:19:08.048060 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.047959 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w5g4d\"" Jul 24 03:19:08.048060 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.047951 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 03:19:08.048768 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.048753 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 03:19:08.048857 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.048769 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 03:19:08.186265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.186182 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:08.242972 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.242944 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:08.305009 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.304974 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xc7cz" event={"ID":"90791e7e-1c44-4ce4-ab9b-89d7f552e444","Type":"ContainerStarted","Data":"6be33d1409071ad27c68552f8b84556ffc8a8189de962d278b8cd72b3e784561"} Jul 24 03:19:08.306506 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.306480 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" event={"ID":"9576d128-6a3e-496f-80be-f23c5de57319","Type":"ContainerStarted","Data":"813945e153cb4536ac40a525f70bb72253dda283404b00bc091e84e645623330"} Jul 24 03:19:08.306640 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.306530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" event={"ID":"9576d128-6a3e-496f-80be-f23c5de57319","Type":"ContainerStarted","Data":"d53f06e96ad5886b1c5b2e4977052117530b151035ea7e3fac7f688da16ad0ee"} Jul 24 03:19:08.306640 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.306560 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:08.307589 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.307572 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmfpq" event={"ID":"d32d592c-d230-4a4a-9fd1-980647cf692e","Type":"ContainerStarted","Data":"8e6663db59b4d17f35330475e783f7f59661e167327dfdd4cbc6cc4068f07bde"} Jul 24 03:19:08.308643 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.308622 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbrmz" event={"ID":"eaa8a88e-64d9-47be-9329-2adcf06f09bc","Type":"ContainerStarted","Data":"2924288ecfad44eb3801caa4f62a7420bcf3a46b157626698d693864ae695c77"} Jul 24 03:19:08.325944 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:08.325886 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" podStartSLOduration=2.32586604 podStartE2EDuration="2.32586604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:19:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:08.325448451 +0000 UTC m=+51.824951802" watchObservedRunningTime="2026-07-24 03:19:08.32586604 +0000 UTC m=+51.825369380" Jul 24 03:19:12.189314 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:12.189258 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:12.297322 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:12.297269 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:12.390783 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:12.390749 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:12.575004 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:12.574973 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:12.776545 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:12.776510 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:12.934865 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:12.934827 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:13.013572 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:13.013539 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:13.139026 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:13.138989 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:13.307599 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:13.307516 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:13.408454 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:13.408421 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:13.512608 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:13.512573 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:13.614077 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:13.614043 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:13.920276 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:13.920162 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:13.990016 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:13.989978 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:14.330743 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:14.330241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xc7cz" event={"ID":"90791e7e-1c44-4ce4-ab9b-89d7f552e444","Type":"ContainerStarted","Data":"3e333483cf4d9c16fbf2f19244cbf11a20ba4894403cc98c83104cd4f2bb6660"} Jul 24 03:19:14.332604 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:14.332569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmfpq" event={"ID":"d32d592c-d230-4a4a-9fd1-980647cf692e","Type":"ContainerStarted","Data":"07c42ba190cdde849fc8b2d6ae6520759efe302ccb60315c14f2aa7be303f5e2"} Jul 24 03:19:14.335381 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:14.335249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbrmz" event={"ID":"eaa8a88e-64d9-47be-9329-2adcf06f09bc","Type":"ContainerStarted","Data":"79cfa86d4e4ec82427860d24042c719c25a0121234a9ac85583d8447b6be5639"} Jul 24 03:19:14.348444 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:14.348385 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xc7cz" podStartSLOduration=0.998310306 podStartE2EDuration="7.348363422s" totalImagesPullingTime="6.350053116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:14.34737661 +0000 UTC m=+57.846879977" watchObservedRunningTime="2026-07-24 03:19:14.348363422 +0000 UTC m=+57.847866752" Jul 24 03:19:14.757780 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:14.757743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:14.963923 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:14.963878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:15.271170 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:15.271111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:15.340626 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:15.340591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmfpq" event={"ID":"d32d592c-d230-4a4a-9fd1-980647cf692e","Type":"ContainerStarted","Data":"017eea7c0b9649ae77471d10d612e0304c324d00fc517ad3e09ac5c48d5b1cc2"} Jul 24 03:19:15.359916 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:15.359869 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmfpq" podStartSLOduration=2.104056202 podStartE2EDuration="8.359854644s" totalImagesPullingTime="6.255798442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:15.359582454 +0000 UTC m=+58.859085796" watchObservedRunningTime="2026-07-24 03:19:15.359854644 +0000 UTC m=+58.859357983" Jul 24 03:19:15.386015 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:15.385981 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:15.592170 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:15.592114 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:15.674536 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:15.674496 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:15.820468 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:15.820424 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:16.343425 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:16.343388 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:18.271354 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:18.271260 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpdwb" Jul 24 03:19:18.350311 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:18.350267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbrmz" event={"ID":"eaa8a88e-64d9-47be-9329-2adcf06f09bc","Type":"ContainerStarted","Data":"a27499ea5cd645aa50a33c9d629e4a2b6d602401f4d7e27a2c56cc314973639c"} Jul 24 03:19:18.482016 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:18.481982 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:18.582124 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:18.582091 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:21.746001 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:21.745912 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:22.367273 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.367239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbrmz" event={"ID":"eaa8a88e-64d9-47be-9329-2adcf06f09bc","Type":"ContainerStarted","Data":"e686e6f811ad9e5a376c42c196bea6824604d78349e90b412182e908230de74f"} Jul 24 03:19:22.385455 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.385409 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbrmz" podStartSLOduration=1.972252712 podStartE2EDuration="15.385394462s" totalImagesPullingTime="13.41314175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:19:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:22.384164375 +0000 UTC m=+65.883667774" watchObservedRunningTime="2026-07-24 03:19:22.385394462 +0000 UTC m=+65.884897801" Jul 24 03:19:22.741958 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.741875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:19:22.744419 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.744387 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 03:19:22.754464 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.754439 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dcb6911-69f1-42b6-8d89-5b8067f71555-metrics-certs\") pod \"network-metrics-daemon-t55cl\" (UID: \"4dcb6911-69f1-42b6-8d89-5b8067f71555\") " pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:19:22.768957 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.768932 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ph9hg\"" Jul 24 03:19:22.776796 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.776777 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t55cl" Jul 24 03:19:22.842501 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.842467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:22.842676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.842530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:19:22.845172 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.845124 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 03:19:22.845172 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.845150 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 03:19:22.855726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.855703 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 03:19:22.855928 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.855909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a10e2dae-e163-47bc-8954-b521f5fa6808-original-pull-secret\") pod \"global-pull-secret-syncer-vm9zb\" (UID: \"a10e2dae-e163-47bc-8954-b521f5fa6808\") " pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:19:22.866125 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.866102 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l76v5\" (UniqueName: \"kubernetes.io/projected/7acb9d6e-7c72-40b5-a232-9e905d29cdf4-kube-api-access-l76v5\") pod \"network-check-target-64mls\" (UID: \"7acb9d6e-7c72-40b5-a232-9e905d29cdf4\") " pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:22.898225 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:22.898191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t55cl"] Jul 24 03:19:22.900889 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:22.900865 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcb6911_69f1_42b6_8d89_5b8067f71555.slice/crio-e9677ea6b1696b13b2ecd5f1b1b188e0013cab615e28e659627dc55583fc04cf WatchSource:0}: Error finding container e9677ea6b1696b13b2ecd5f1b1b188e0013cab615e28e659627dc55583fc04cf: Status 404 returned error can't find the container with id e9677ea6b1696b13b2ecd5f1b1b188e0013cab615e28e659627dc55583fc04cf Jul 24 03:19:23.057661 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.057588 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w5g4d\"" Jul 24 03:19:23.060656 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.060642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm9zb" Jul 24 03:19:23.066256 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.066231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:23.191263 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.191231 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vm9zb"] Jul 24 03:19:23.194596 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:23.194566 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10e2dae_e163_47bc_8954_b521f5fa6808.slice/crio-1d5544fa12a30a4edaa1eac30cdd8f901380f53b8e778c3d8b4c26f1d71ef233 WatchSource:0}: Error finding container 1d5544fa12a30a4edaa1eac30cdd8f901380f53b8e778c3d8b4c26f1d71ef233: Status 404 returned error can't find the container with id 1d5544fa12a30a4edaa1eac30cdd8f901380f53b8e778c3d8b4c26f1d71ef233 Jul 24 03:19:23.207889 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.207862 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64mls"] Jul 24 03:19:23.211693 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:23.211669 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acb9d6e_7c72_40b5_a232_9e905d29cdf4.slice/crio-50d099754ce9db0d9dd63a7d21d866eb94f76ca36810ca36fd24e19b8f566a9e WatchSource:0}: Error finding container 50d099754ce9db0d9dd63a7d21d866eb94f76ca36810ca36fd24e19b8f566a9e: Status 404 returned error can't find the container with id 50d099754ce9db0d9dd63a7d21d866eb94f76ca36810ca36fd24e19b8f566a9e Jul 24 03:19:23.370966 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.370932 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64mls" event={"ID":"7acb9d6e-7c72-40b5-a232-9e905d29cdf4","Type":"ContainerStarted","Data":"50d099754ce9db0d9dd63a7d21d866eb94f76ca36810ca36fd24e19b8f566a9e"} Jul 24 03:19:23.372005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.371982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vm9zb" event={"ID":"a10e2dae-e163-47bc-8954-b521f5fa6808","Type":"ContainerStarted","Data":"1d5544fa12a30a4edaa1eac30cdd8f901380f53b8e778c3d8b4c26f1d71ef233"} Jul 24 03:19:23.373035 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.373015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t55cl" event={"ID":"4dcb6911-69f1-42b6-8d89-5b8067f71555","Type":"ContainerStarted","Data":"e9677ea6b1696b13b2ecd5f1b1b188e0013cab615e28e659627dc55583fc04cf"} Jul 24 03:19:23.566266 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.566240 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:23.667201 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.667109 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:23.768389 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.768355 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:23.803626 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.803590 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd7d5f8c7-w27fp"] Jul 24 03:19:23.806813 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.806718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:23.810211 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.809790 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 03:19:23.810211 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.809667 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 03:19:23.810211 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.809983 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 03:19:23.810211 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.810093 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 03:19:23.810211 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.810109 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 03:19:23.810950 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.810932 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mvmn5\"" Jul 24 03:19:23.811663 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.811170 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 03:19:23.812102 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.812080 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 03:19:23.816924 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.816895 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 03:19:23.824350 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.824067 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd7d5f8c7-w27fp"] Jul 24 03:19:23.859812 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.859721 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:23.951916 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.951835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-serving-cert\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:23.951916 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.951872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-oauth-config\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:23.951916 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.951890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-trusted-ca-bundle\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:23.951916 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.951905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-oauth-serving-cert\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:23.951916 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.951922 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmzgd\" (UniqueName: \"kubernetes.io/projected/13fb65d8-dfc1-498d-b6db-a6314f54673f-kube-api-access-jmzgd\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:23.952280 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.952056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-config\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:23.952280 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.952115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-service-ca\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:23.972529 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:23.972493 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:24.021654 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.021613 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vtz7z"] Jul 24 03:19:24.024124 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.024102 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m"] Jul 24 03:19:24.024268 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.024241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.026496 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.026414 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.027286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.027066 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rs2nn\"" Jul 24 03:19:24.027286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.027066 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 03:19:24.027286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.027130 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 03:19:24.027587 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.027400 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 03:19:24.027587 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.027461 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 03:19:24.027693 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.027658 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 03:19:24.028104 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.027827 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 03:19:24.029353 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.029285 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 03:19:24.029950 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.029610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 03:19:24.029950 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.029625 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 03:19:24.029950 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.029916 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8fhsz\"" Jul 24 03:19:24.038955 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.038226 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m"] Jul 24 03:19:24.053051 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.053027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-serving-cert\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.053192 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.053065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-oauth-config\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.053192 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.053102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-trusted-ca-bundle\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.053192 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.053126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-oauth-serving-cert\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.053192 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.053148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmzgd\" (UniqueName: \"kubernetes.io/projected/13fb65d8-dfc1-498d-b6db-a6314f54673f-kube-api-access-jmzgd\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.053419 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.053203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-config\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.053419 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.053235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-service-ca\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.054614 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.054589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-config\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.054769 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.054649 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-service-ca\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.055125 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.055027 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-trusted-ca-bundle\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.055344 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.055288 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-oauth-serving-cert\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.062183 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.057618 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-oauth-config\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.062183 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.058568 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-serving-cert\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.062183 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.058970 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:24.069025 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.068998 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmzgd\" (UniqueName: \"kubernetes.io/projected/13fb65d8-dfc1-498d-b6db-a6314f54673f-kube-api-access-jmzgd\") pod \"console-7bd7d5f8c7-w27fp\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.124819 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.124725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:24.153850 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.153813 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.154038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.153862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.154038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.153888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/654a3789-1c1f-435d-9d55-b3bec3c0d67a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.154038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.153913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4521334e-c39c-4852-91e3-a7e734af80d5-metrics-client-ca\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.154038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.153941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.154038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.153978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmd88\" (UniqueName: \"kubernetes.io/projected/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-api-access-mmd88\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.154038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154008 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-root\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.154038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-tls\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.154343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94sz7\" (UniqueName: \"kubernetes.io/projected/4521334e-c39c-4852-91e3-a7e734af80d5-kube-api-access-94sz7\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.154343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-sys\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.154343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-wtmp\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.154343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154163 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/654a3789-1c1f-435d-9d55-b3bec3c0d67a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.154343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.154343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-textfile\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.154343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.154254 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.250143 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.250104 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:24.255328 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.255328 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.255328 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/654a3789-1c1f-435d-9d55-b3bec3c0d67a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4521334e-c39c-4852-91e3-a7e734af80d5-metrics-client-ca\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmd88\" (UniqueName: \"kubernetes.io/projected/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-api-access-mmd88\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-root\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-tls\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94sz7\" (UniqueName: \"kubernetes.io/projected/4521334e-c39c-4852-91e3-a7e734af80d5-kube-api-access-94sz7\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-sys\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-wtmp\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/654a3789-1c1f-435d-9d55-b3bec3c0d67a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-textfile\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.255697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.255699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.256790 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.256383 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.257078 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.257056 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/654a3789-1c1f-435d-9d55-b3bec3c0d67a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.258693 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.257171 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-root\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.258693 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.257687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4521334e-c39c-4852-91e3-a7e734af80d5-metrics-client-ca\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.258693 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:24.257914 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 24 03:19:24.258693 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:19:24.258005 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-tls podName:654a3789-1c1f-435d-9d55-b3bec3c0d67a nodeName:}" failed. No retries permitted until 2026-07-24 03:19:24.757984927 +0000 UTC m=+68.257488258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-wdg5m" (UID: "654a3789-1c1f-435d-9d55-b3bec3c0d67a") : secret "kube-state-metrics-tls" not found Jul 24 03:19:24.258693 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.258007 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.258693 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.258093 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-wtmp\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.258693 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.258349 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4521334e-c39c-4852-91e3-a7e734af80d5-sys\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.258693 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.258653 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/654a3789-1c1f-435d-9d55-b3bec3c0d67a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.259140 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.258887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-textfile\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.260074 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.260032 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-tls\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.260167 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.260100 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4521334e-c39c-4852-91e3-a7e734af80d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.261337 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.261314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.271177 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.270673 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmd88\" (UniqueName: \"kubernetes.io/projected/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-api-access-mmd88\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.271177 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.271161 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94sz7\" (UniqueName: \"kubernetes.io/projected/4521334e-c39c-4852-91e3-a7e734af80d5-kube-api-access-94sz7\") pod \"node-exporter-vtz7z\" (UID: \"4521334e-c39c-4852-91e3-a7e734af80d5\") " pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.295818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.295783 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd7d5f8c7-w27fp"] Jul 24 03:19:24.299715 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:24.299685 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fb65d8_dfc1_498d_b6db_a6314f54673f.slice/crio-eaa12cefe736a5fb32a042cf3b5b0fa25c557b341ea12a0a4036ab888d9fea06 WatchSource:0}: Error finding container eaa12cefe736a5fb32a042cf3b5b0fa25c557b341ea12a0a4036ab888d9fea06: Status 404 returned error can't find the container with id eaa12cefe736a5fb32a042cf3b5b0fa25c557b341ea12a0a4036ab888d9fea06 Jul 24 03:19:24.340539 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.340499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vtz7z" Jul 24 03:19:24.351658 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.351627 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:24.354471 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:24.354438 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4521334e_c39c_4852_91e3_a7e734af80d5.slice/crio-0560f31c0c26b2598ef60726916b58fa21f9c8772f0df21f06c5cbe15ac5ffba WatchSource:0}: Error finding container 0560f31c0c26b2598ef60726916b58fa21f9c8772f0df21f06c5cbe15ac5ffba: Status 404 returned error can't find the container with id 0560f31c0c26b2598ef60726916b58fa21f9c8772f0df21f06c5cbe15ac5ffba Jul 24 03:19:24.379393 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.379354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtz7z" event={"ID":"4521334e-c39c-4852-91e3-a7e734af80d5","Type":"ContainerStarted","Data":"0560f31c0c26b2598ef60726916b58fa21f9c8772f0df21f06c5cbe15ac5ffba"} Jul 24 03:19:24.380906 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.380874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd7d5f8c7-w27fp" event={"ID":"13fb65d8-dfc1-498d-b6db-a6314f54673f","Type":"ContainerStarted","Data":"eaa12cefe736a5fb32a042cf3b5b0fa25c557b341ea12a0a4036ab888d9fea06"} Jul 24 03:19:24.382958 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.382929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t55cl" event={"ID":"4dcb6911-69f1-42b6-8d89-5b8067f71555","Type":"ContainerStarted","Data":"aa91e56894bb699855de424ebe3f7c7f77643e1b23f368c574821d962487622f"} Jul 24 03:19:24.383089 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.382983 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t55cl" event={"ID":"4dcb6911-69f1-42b6-8d89-5b8067f71555","Type":"ContainerStarted","Data":"5f27e8fb965638dac6a1ddb91069bb44fb913c66115ec186bd7d09ccdf932ebe"} Jul 24 03:19:24.401834 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.401775 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t55cl" podStartSLOduration=66.591776519 podStartE2EDuration="1m7.401755083s" totalImagesPullingTime="809.978564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:24.400569418 +0000 UTC m=+67.900072793" watchObservedRunningTime="2026-07-24 03:19:24.401755083 +0000 UTC m=+67.901258424" Jul 24 03:19:24.449141 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.449104 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:24.550075 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.549986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:24.650241 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.650190 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:24.707240 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.707192 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:24.759908 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.759872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.764928 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.764901 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/654a3789-1c1f-435d-9d55-b3bec3c0d67a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-wdg5m\" (UID: \"654a3789-1c1f-435d-9d55-b3bec3c0d67a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.946979 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.946936 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" Jul 24 03:19:24.958407 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:24.958377 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:25.058767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.058697 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:25.163392 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.163274 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m"] Jul 24 03:19:25.165730 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.165677 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:25.168925 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:25.168549 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654a3789_1c1f_435d_9d55_b3bec3c0d67a.slice/crio-228d79d6a72bf7ebb24dd58f0cc33ce8f711234a63346486854f0c996ff77f19 WatchSource:0}: Error finding container 228d79d6a72bf7ebb24dd58f0cc33ce8f711234a63346486854f0c996ff77f19: Status 404 returned error can't find the container with id 228d79d6a72bf7ebb24dd58f0cc33ce8f711234a63346486854f0c996ff77f19 Jul 24 03:19:25.390316 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.389717 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" event={"ID":"654a3789-1c1f-435d-9d55-b3bec3c0d67a","Type":"ContainerStarted","Data":"228d79d6a72bf7ebb24dd58f0cc33ce8f711234a63346486854f0c996ff77f19"} Jul 24 03:19:25.980751 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.980666 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw"] Jul 24 03:19:25.996536 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.995825 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:25.996536 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.995984 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw"] Jul 24 03:19:25.998881 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.998658 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 03:19:25.998881 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.998677 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8o9b4foj22lvn\"" Jul 24 03:19:25.998881 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.998861 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 03:19:25.999181 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.999164 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bhdxm\"" Jul 24 03:19:25.999308 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.999274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 03:19:25.999380 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.999370 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 03:19:25.999710 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:25.999650 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 03:19:26.019464 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.019428 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:26.071907 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.071869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.072093 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.072003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-tls\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.072093 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.072035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.072093 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.072087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.072262 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.072184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-grpc-tls\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.072262 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.072212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.072393 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.072320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27tqb\" (UniqueName: \"kubernetes.io/projected/7a051985-d681-4173-a8b6-f58a31ad6586-kube-api-access-27tqb\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.072393 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.072365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a051985-d681-4173-a8b6-f58a31ad6586-metrics-client-ca\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.121521 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.121486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:26.172864 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.172824 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27tqb\" (UniqueName: \"kubernetes.io/projected/7a051985-d681-4173-a8b6-f58a31ad6586-kube-api-access-27tqb\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.173042 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.172877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a051985-d681-4173-a8b6-f58a31ad6586-metrics-client-ca\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.173042 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.172916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.173042 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.172967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-tls\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.173042 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.172993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.173042 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.173019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.173262 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.173059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-grpc-tls\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.173262 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.173082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.173735 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.173710 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a051985-d681-4173-a8b6-f58a31ad6586-metrics-client-ca\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.176840 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.176313 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.176840 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.176767 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.176840 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.176786 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-tls\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.176840 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.176787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-grpc-tls\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.177437 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.177394 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.178689 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.178664 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a051985-d681-4173-a8b6-f58a31ad6586-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.181964 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.181760 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27tqb\" (UniqueName: \"kubernetes.io/projected/7a051985-d681-4173-a8b6-f58a31ad6586-kube-api-access-27tqb\") pod \"thanos-querier-6c8979b4c6-4fmlw\" (UID: \"7a051985-d681-4173-a8b6-f58a31ad6586\") " pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.309852 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.309772 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:26.349223 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.349195 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmfpq" Jul 24 03:19:26.919804 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:26.919769 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:27.020021 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:27.019986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:27.188167 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:27.188085 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:27.284199 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:27.284157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:27.629957 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:27.629916 2564 patch_prober.go:28] interesting pod/image-registry-5d86b496cc-rhvn4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 24 03:19:27.630134 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:27.629985 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" podUID="9576d128-6a3e-496f-80be-f23c5de57319" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 03:19:28.772728 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.772690 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:28.791744 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.791712 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44"] Jul 24 03:19:28.794391 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.794364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:28.797026 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.797004 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bttgk\"" Jul 24 03:19:28.797172 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.797044 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 24 03:19:28.813282 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.813252 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44"] Jul 24 03:19:28.874952 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.874915 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:28.896646 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.896615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7wlj\" (UniqueName: \"kubernetes.io/projected/038e38a6-03da-4f01-a29d-6d9ce17473f9-kube-api-access-p7wlj\") pod \"monitoring-plugin-68b7fc9574-nbs44\" (UID: \"038e38a6-03da-4f01-a29d-6d9ce17473f9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:28.896837 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.896727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/038e38a6-03da-4f01-a29d-6d9ce17473f9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-nbs44\" (UID: \"038e38a6-03da-4f01-a29d-6d9ce17473f9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:28.975567 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.975521 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:28.997521 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.997487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/038e38a6-03da-4f01-a29d-6d9ce17473f9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-nbs44\" (UID: \"038e38a6-03da-4f01-a29d-6d9ce17473f9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:28.997709 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:28.997529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7wlj\" (UniqueName: \"kubernetes.io/projected/038e38a6-03da-4f01-a29d-6d9ce17473f9-kube-api-access-p7wlj\") pod \"monitoring-plugin-68b7fc9574-nbs44\" (UID: \"038e38a6-03da-4f01-a29d-6d9ce17473f9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:29.000136 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:29.000105 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/038e38a6-03da-4f01-a29d-6d9ce17473f9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-nbs44\" (UID: \"038e38a6-03da-4f01-a29d-6d9ce17473f9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:29.006094 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:29.006041 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7wlj\" (UniqueName: \"kubernetes.io/projected/038e38a6-03da-4f01-a29d-6d9ce17473f9-kube-api-access-p7wlj\") pod \"monitoring-plugin-68b7fc9574-nbs44\" (UID: \"038e38a6-03da-4f01-a29d-6d9ce17473f9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:29.105049 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:29.105007 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:29.320933 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:29.320907 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d86b496cc-rhvn4" Jul 24 03:19:29.441351 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:29.441244 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:29.578653 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:29.578610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:29.681001 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:29.680948 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:30.166971 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.166888 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:30.288746 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.287521 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44"] Jul 24 03:19:30.292807 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:19:30.292742 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038e38a6_03da_4f01_a29d_6d9ce17473f9.slice/crio-334fa9a593b1c6d40efdc2f647e4590c6477c15af9615ed1b897298b53dacd94 WatchSource:0}: Error finding container 334fa9a593b1c6d40efdc2f647e4590c6477c15af9615ed1b897298b53dacd94: Status 404 returned error can't find the container with id 334fa9a593b1c6d40efdc2f647e4590c6477c15af9615ed1b897298b53dacd94 Jul 24 03:19:30.323588 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.322645 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw"] Jul 24 03:19:30.414110 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.413443 2564 generic.go:356] "Generic (PLEG): container finished" podID="4521334e-c39c-4852-91e3-a7e734af80d5" containerID="d11d79b7d5d929dadc239124afcd75c389fba0cadd9eb48977161b960a946fa7" exitCode=0 Jul 24 03:19:30.414110 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.413541 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtz7z" event={"ID":"4521334e-c39c-4852-91e3-a7e734af80d5","Type":"ContainerDied","Data":"d11d79b7d5d929dadc239124afcd75c389fba0cadd9eb48977161b960a946fa7"} Jul 24 03:19:30.418379 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.417862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" event={"ID":"038e38a6-03da-4f01-a29d-6d9ce17473f9","Type":"ContainerStarted","Data":"334fa9a593b1c6d40efdc2f647e4590c6477c15af9615ed1b897298b53dacd94"} Jul 24 03:19:30.421280 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.420773 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd7d5f8c7-w27fp" event={"ID":"13fb65d8-dfc1-498d-b6db-a6314f54673f","Type":"ContainerStarted","Data":"4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d"} Jul 24 03:19:30.423645 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.423500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64mls" event={"ID":"7acb9d6e-7c72-40b5-a232-9e905d29cdf4","Type":"ContainerStarted","Data":"885bc63b0cd96d1a8684fec1aff99138d662031816a78d8797a00bc0950adc25"} Jul 24 03:19:30.425083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.425040 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:19:30.426149 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.426037 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vm9zb" event={"ID":"a10e2dae-e163-47bc-8954-b521f5fa6808","Type":"ContainerStarted","Data":"3541861c5ee51e8d4e19c8be108844e02f77dab14366e4120dd5de087de17dc1"} Jul 24 03:19:30.429003 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.428975 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" event={"ID":"654a3789-1c1f-435d-9d55-b3bec3c0d67a","Type":"ContainerStarted","Data":"66291972aa605a7541e9fe60542e2dc6fd54dcb583c60e2f47da4c4d01dbee68"} Jul 24 03:19:30.429111 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.429038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" event={"ID":"654a3789-1c1f-435d-9d55-b3bec3c0d67a","Type":"ContainerStarted","Data":"3568a284ed676f88627d1f8ce982d3385cc0f0701eb36d26e3a124deba6a03ac"} Jul 24 03:19:30.429111 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.429074 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" event={"ID":"654a3789-1c1f-435d-9d55-b3bec3c0d67a","Type":"ContainerStarted","Data":"0db2e467c95b7a42f8a612f1c1d8f5c96b6ef68eca68f094a7f074409d9978bd"} Jul 24 03:19:30.433221 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.433142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" event={"ID":"7a051985-d681-4173-a8b6-f58a31ad6586","Type":"ContainerStarted","Data":"edf3b2e9d56c4209936a26e94256dd25271f9f1f29c156e2612b7cedc51c43dc"} Jul 24 03:19:30.449313 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.449102 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd7d5f8c7-w27fp" podStartSLOduration=1.641176336 podStartE2EDuration="7.449082259s" totalImagesPullingTime="5.807905923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:30.447746313 +0000 UTC m=+73.947249653" watchObservedRunningTime="2026-07-24 03:19:30.449082259 +0000 UTC m=+73.948585602" Jul 24 03:19:30.465058 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.464998 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-64mls" podStartSLOduration=65.569924999 podStartE2EDuration="1m12.464975346s" totalImagesPullingTime="6.895050347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:30.464151124 +0000 UTC m=+73.963654466" watchObservedRunningTime="2026-07-24 03:19:30.464975346 +0000 UTC m=+73.964478687" Jul 24 03:19:30.482192 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.482136 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vm9zb" podStartSLOduration=65.568196911 podStartE2EDuration="1m12.482117817s" totalImagesPullingTime="6.913920906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:30.481431666 +0000 UTC m=+73.980935046" watchObservedRunningTime="2026-07-24 03:19:30.482117817 +0000 UTC m=+73.981621155" Jul 24 03:19:30.498855 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.498814 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-wdg5m" podStartSLOduration=1.564514334 podStartE2EDuration="6.498800315s" totalImagesPullingTime="4.934285981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:30.498315622 +0000 UTC m=+73.997818962" watchObservedRunningTime="2026-07-24 03:19:30.498800315 +0000 UTC m=+73.998303655" Jul 24 03:19:30.959382 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:30.959351 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:31.060827 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:31.060798 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:31.160640 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:31.160574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:31.441112 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:31.440847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtz7z" event={"ID":"4521334e-c39c-4852-91e3-a7e734af80d5","Type":"ContainerStarted","Data":"be3ee6c696250cb17d2b6c69fa98c5195ccb5802dcc2789e06162636c6ca7e57"} Jul 24 03:19:31.441112 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:31.440914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtz7z" event={"ID":"4521334e-c39c-4852-91e3-a7e734af80d5","Type":"ContainerStarted","Data":"3434661891aed9404e500615dd952cc061985f84e642c8460792fd2ffd3f3c58"} Jul 24 03:19:31.461343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:31.461188 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vtz7z" podStartSLOduration=2.582814939 podStartE2EDuration="8.461170265s" totalImagesPullingTime="5.739438264s" totalInitContainerRuntime="138.917062ms" isStatefulPod=true podCreationTimestamp="2026-07-24 03:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:31.459579176 +0000 UTC m=+74.959082527" watchObservedRunningTime="2026-07-24 03:19:31.461170265 +0000 UTC m=+74.960673604" Jul 24 03:19:32.446528 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:32.446427 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" event={"ID":"7a051985-d681-4173-a8b6-f58a31ad6586","Type":"ContainerStarted","Data":"38ab947a36e9aa880c0f149664c428015b103297a2694b5801bc14eca3a62afd"} Jul 24 03:19:32.446953 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:32.446539 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" event={"ID":"7a051985-d681-4173-a8b6-f58a31ad6586","Type":"ContainerStarted","Data":"587e7504f70a92d1faf86daf9bd1eece245829da79e8daf67ac0428183cedbfd"} Jul 24 03:19:32.446953 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:32.446578 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" event={"ID":"7a051985-d681-4173-a8b6-f58a31ad6586","Type":"ContainerStarted","Data":"e6b937fdd6af9f4585f4bdb3255e800aa2bdd9c41b2e1b4bda1649e8e6b5fc8f"} Jul 24 03:19:32.447960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:32.447937 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" event={"ID":"038e38a6-03da-4f01-a29d-6d9ce17473f9","Type":"ContainerStarted","Data":"54269a33252afc556481ae02dba65dbf8bbd37eadec56547951efbaace09213e"} Jul 24 03:19:32.467749 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:32.467695 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" podStartSLOduration=2.671804376 podStartE2EDuration="4.467678166s" totalImagesPullingTime="1.79587379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:32.466663469 +0000 UTC m=+75.966166808" watchObservedRunningTime="2026-07-24 03:19:32.467678166 +0000 UTC m=+75.967181505" Jul 24 03:19:32.589512 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:32.589478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:32.664625 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:32.664594 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:33.454596 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:33.454554 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" event={"ID":"7a051985-d681-4173-a8b6-f58a31ad6586","Type":"ContainerStarted","Data":"79d57983a4fe4198cafdd7a7613553d509f41a630aadc1a393871a20e2e3f941"} Jul 24 03:19:33.455122 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:33.454631 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" event={"ID":"7a051985-d681-4173-a8b6-f58a31ad6586","Type":"ContainerStarted","Data":"8272f5044538ac6b13f2e7bca2474c8ac9b7e4e4fe009417613dcf770bcd6df1"} Jul 24 03:19:33.455122 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:33.454705 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:33.455122 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:33.454746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" event={"ID":"7a051985-d681-4173-a8b6-f58a31ad6586","Type":"ContainerStarted","Data":"d8a3d046fadfb4c8609eb7b7719a9bc4958875cbd642775664309379331d1e0b"} Jul 24 03:19:33.459369 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:33.459341 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nbs44" Jul 24 03:19:33.477591 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:33.477544 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" podStartSLOduration=6.030517376 podStartE2EDuration="8.477526824s" totalImagesPullingTime="2.447009448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:19:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:33.47646559 +0000 UTC m=+76.975968930" watchObservedRunningTime="2026-07-24 03:19:33.477526824 +0000 UTC m=+76.977030189" Jul 24 03:19:34.127549 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:34.127422 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:34.127722 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:34.127599 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:34.131235 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:34.131208 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:34.462699 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:34.462599 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:34.465899 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:34.465880 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:19:35.119312 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:35.119271 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:35.219920 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:35.219880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:35.427077 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:35.426991 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:35.486023 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:35.485983 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:37.581261 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:37.581222 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:37.682443 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:37.682415 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:38.187216 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:38.187177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:38.240032 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:38.239915 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:40.471574 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:40.471549 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c8979b4c6-4fmlw" Jul 24 03:19:41.440514 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:41.440477 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:41.532509 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:41.532469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:41.633644 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:41.633611 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:44.388710 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:44.388678 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:44.486368 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:44.486337 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:44.545743 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:44.545711 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:48.252131 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:48.252099 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:48.323043 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:48.323010 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:48.380987 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:48.380950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:50.231787 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:50.231753 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd7d5f8c7-w27fp"] Jul 24 03:19:50.343211 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:50.343177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:50.442089 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:50.442051 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:50.490440 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:50.490358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:53.184824 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:53.184791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:19:53.286023 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:19:53.285990 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:20:01.444629 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:01.444596 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-64mls" Jul 24 03:20:15.252734 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.252671 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bd7d5f8c7-w27fp" podUID="13fb65d8-dfc1-498d-b6db-a6314f54673f" containerName="console" containerID="cri-o://4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d" gracePeriod=15 Jul 24 03:20:15.489798 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.489772 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:20:15.549797 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.549707 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-trusted-ca-bundle\") pod \"13fb65d8-dfc1-498d-b6db-a6314f54673f\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " Jul 24 03:20:15.549797 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.549756 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-oauth-config\") pod \"13fb65d8-dfc1-498d-b6db-a6314f54673f\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " Jul 24 03:20:15.549797 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.549787 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-config\") pod \"13fb65d8-dfc1-498d-b6db-a6314f54673f\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " Jul 24 03:20:15.550068 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.549814 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-serving-cert\") pod \"13fb65d8-dfc1-498d-b6db-a6314f54673f\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " Jul 24 03:20:15.550068 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.549841 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-service-ca\") pod \"13fb65d8-dfc1-498d-b6db-a6314f54673f\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " Jul 24 03:20:15.550068 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.549892 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmzgd\" (UniqueName: \"kubernetes.io/projected/13fb65d8-dfc1-498d-b6db-a6314f54673f-kube-api-access-jmzgd\") pod \"13fb65d8-dfc1-498d-b6db-a6314f54673f\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " Jul 24 03:20:15.550068 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.549932 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-oauth-serving-cert\") pod \"13fb65d8-dfc1-498d-b6db-a6314f54673f\" (UID: \"13fb65d8-dfc1-498d-b6db-a6314f54673f\") " Jul 24 03:20:15.550266 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.550239 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "13fb65d8-dfc1-498d-b6db-a6314f54673f" (UID: "13fb65d8-dfc1-498d-b6db-a6314f54673f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:20:15.550406 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.550382 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-config" (OuterVolumeSpecName: "console-config") pod "13fb65d8-dfc1-498d-b6db-a6314f54673f" (UID: "13fb65d8-dfc1-498d-b6db-a6314f54673f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:20:15.550471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.550391 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-service-ca" (OuterVolumeSpecName: "service-ca") pod "13fb65d8-dfc1-498d-b6db-a6314f54673f" (UID: "13fb65d8-dfc1-498d-b6db-a6314f54673f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:20:15.550512 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.550460 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "13fb65d8-dfc1-498d-b6db-a6314f54673f" (UID: "13fb65d8-dfc1-498d-b6db-a6314f54673f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:20:15.552184 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.552153 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "13fb65d8-dfc1-498d-b6db-a6314f54673f" (UID: "13fb65d8-dfc1-498d-b6db-a6314f54673f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:20:15.552184 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.552166 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13fb65d8-dfc1-498d-b6db-a6314f54673f-kube-api-access-jmzgd" (OuterVolumeSpecName: "kube-api-access-jmzgd") pod "13fb65d8-dfc1-498d-b6db-a6314f54673f" (UID: "13fb65d8-dfc1-498d-b6db-a6314f54673f"). InnerVolumeSpecName "kube-api-access-jmzgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:20:15.552340 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.552218 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "13fb65d8-dfc1-498d-b6db-a6314f54673f" (UID: "13fb65d8-dfc1-498d-b6db-a6314f54673f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:20:15.604754 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.604719 2564 generic.go:356] "Generic (PLEG): container finished" podID="13fb65d8-dfc1-498d-b6db-a6314f54673f" containerID="4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d" exitCode=0 Jul 24 03:20:15.604930 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.604764 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd7d5f8c7-w27fp" Jul 24 03:20:15.604930 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.604803 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd7d5f8c7-w27fp" event={"ID":"13fb65d8-dfc1-498d-b6db-a6314f54673f","Type":"ContainerDied","Data":"4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d"} Jul 24 03:20:15.604930 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.604860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd7d5f8c7-w27fp" event={"ID":"13fb65d8-dfc1-498d-b6db-a6314f54673f","Type":"ContainerDied","Data":"eaa12cefe736a5fb32a042cf3b5b0fa25c557b341ea12a0a4036ab888d9fea06"} Jul 24 03:20:15.604930 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.604886 2564 scope.go:117] "RemoveContainer" containerID="4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d" Jul 24 03:20:15.613660 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.613641 2564 scope.go:117] "RemoveContainer" containerID="4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d" Jul 24 03:20:15.613961 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:20:15.613937 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d\": container with ID starting with 4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d not found: ID does not exist" containerID="4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d" Jul 24 03:20:15.614034 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.613968 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d"} err="failed to get container status \"4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d\": rpc error: code = NotFound desc = could not find container \"4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d\": container with ID starting with 4c431339bf2680b717b23d236614a387eaeaefb388d62c8115986f5e0898262d not found: ID does not exist" Jul 24 03:20:15.626460 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.626433 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd7d5f8c7-w27fp"] Jul 24 03:20:15.630571 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.630550 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd7d5f8c7-w27fp"] Jul 24 03:20:15.650684 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.650656 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-oauth-config\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:20:15.650684 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.650680 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-config\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:20:15.650811 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.650690 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13fb65d8-dfc1-498d-b6db-a6314f54673f-console-serving-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:20:15.650811 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.650698 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-service-ca\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:20:15.650811 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.650707 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmzgd\" (UniqueName: \"kubernetes.io/projected/13fb65d8-dfc1-498d-b6db-a6314f54673f-kube-api-access-jmzgd\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:20:15.650811 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.650714 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-oauth-serving-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:20:15.650811 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:15.650722 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fb65d8-dfc1-498d-b6db-a6314f54673f-trusted-ca-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:20:17.049576 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:17.049543 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13fb65d8-dfc1-498d-b6db-a6314f54673f" path="/var/lib/kubelet/pods/13fb65d8-dfc1-498d-b6db-a6314f54673f/volumes" Jul 24 03:20:43.189487 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:43.189437 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:20:43.421951 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:43.421917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:20:48.267094 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.267060 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65dc648fc5-nmxw7"] Jul 24 03:20:48.267569 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.267456 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13fb65d8-dfc1-498d-b6db-a6314f54673f" containerName="console" Jul 24 03:20:48.267569 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.267473 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="13fb65d8-dfc1-498d-b6db-a6314f54673f" containerName="console" Jul 24 03:20:48.267569 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.267539 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="13fb65d8-dfc1-498d-b6db-a6314f54673f" containerName="console" Jul 24 03:20:48.269451 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.269437 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.271870 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.271850 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 03:20:48.271991 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.271886 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 03:20:48.271991 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.271850 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 03:20:48.271991 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.271906 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 03:20:48.271991 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.271913 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v8x88\"" Jul 24 03:20:48.272260 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.272052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 03:20:48.276524 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.276507 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 03:20:48.281899 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.281876 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65dc648fc5-nmxw7"] Jul 24 03:20:48.399345 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.399288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-metrics-client-ca\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.399516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.399360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-secret-telemeter-client\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.399516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.399395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-federate-client-tls\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.399516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.399413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.399516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.399443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzd2v\" (UniqueName: \"kubernetes.io/projected/98e161c1-e595-4c42-af2f-4d52521f3602-kube-api-access-rzd2v\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.399516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.399487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-serving-certs-ca-bundle\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.399698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.399518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-telemeter-client-tls\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.399698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.399544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.500419 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.500232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-metrics-client-ca\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.500664 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.500644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-secret-telemeter-client\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.500736 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.500723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-federate-client-tls\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.500796 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.500779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.500848 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.500822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzd2v\" (UniqueName: \"kubernetes.io/projected/98e161c1-e595-4c42-af2f-4d52521f3602-kube-api-access-rzd2v\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.500900 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.500856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-serving-certs-ca-bundle\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.500954 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.500906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-telemeter-client-tls\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.501005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.500962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.501522 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.501487 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-metrics-client-ca\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.502164 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.501826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.503461 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.502889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e161c1-e595-4c42-af2f-4d52521f3602-serving-certs-ca-bundle\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.504103 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.504052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.504334 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.504310 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-secret-telemeter-client\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.504568 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.504547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-federate-client-tls\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.508369 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.508348 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98e161c1-e595-4c42-af2f-4d52521f3602-telemeter-client-tls\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.510099 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.510078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzd2v\" (UniqueName: \"kubernetes.io/projected/98e161c1-e595-4c42-af2f-4d52521f3602-kube-api-access-rzd2v\") pod \"telemeter-client-65dc648fc5-nmxw7\" (UID: \"98e161c1-e595-4c42-af2f-4d52521f3602\") " pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.579082 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.579045 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" Jul 24 03:20:48.711898 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.711871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65dc648fc5-nmxw7"] Jul 24 03:20:48.714414 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:20:48.714389 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e161c1_e595_4c42_af2f_4d52521f3602.slice/crio-6f163160afd37308885e96086879226aa37751e69e1e6209ad8e729920412a2e WatchSource:0}: Error finding container 6f163160afd37308885e96086879226aa37751e69e1e6209ad8e729920412a2e: Status 404 returned error can't find the container with id 6f163160afd37308885e96086879226aa37751e69e1e6209ad8e729920412a2e Jul 24 03:20:48.727575 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:48.727544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" event={"ID":"98e161c1-e595-4c42-af2f-4d52521f3602","Type":"ContainerStarted","Data":"6f163160afd37308885e96086879226aa37751e69e1e6209ad8e729920412a2e"} Jul 24 03:20:50.736759 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:50.736675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" event={"ID":"98e161c1-e595-4c42-af2f-4d52521f3602","Type":"ContainerStarted","Data":"d55823fc5471545fe84d66e445dcacd2918ffc3265ceb6082e8b4ec4f3c89186"} Jul 24 03:20:51.741615 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:51.741529 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" event={"ID":"98e161c1-e595-4c42-af2f-4d52521f3602","Type":"ContainerStarted","Data":"826b3c48d99ebebcc3b941807acbddf58f101d95e22cd59524cb9d6b517132e5"} Jul 24 03:20:51.741615 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:51.741585 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" event={"ID":"98e161c1-e595-4c42-af2f-4d52521f3602","Type":"ContainerStarted","Data":"b155473cc9eb33f82074e0ac850852c4aeed27baedf5197a90bebf303bc73d78"} Jul 24 03:20:51.766273 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:51.766209 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65dc648fc5-nmxw7" podStartSLOduration=1.142444466 podStartE2EDuration="3.766186749s" totalImagesPullingTime="2.623742283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:20:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:20:51.76504195 +0000 UTC m=+155.264545301" watchObservedRunningTime="2026-07-24 03:20:51.766186749 +0000 UTC m=+155.265690088" Jul 24 03:20:52.486134 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.484129 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-855664f957-k7td8"] Jul 24 03:20:52.487490 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.487445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.489979 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.489958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 03:20:52.490448 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.490429 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 03:20:52.492401 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.492387 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 03:20:52.493530 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.493509 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 03:20:52.493618 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.493554 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 03:20:52.493618 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.493581 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 03:20:52.493783 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.493767 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 03:20:52.494047 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.494031 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mvmn5\"" Jul 24 03:20:52.496962 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.496943 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 03:20:52.514445 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.514409 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-855664f957-k7td8"] Jul 24 03:20:52.570458 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.570421 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:20:52.636595 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.636556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lq6g\" (UniqueName: \"kubernetes.io/projected/e0c440c9-54f5-4fe6-9029-119328cfcbfc-kube-api-access-2lq6g\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.636761 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.636620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-oauth-config\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.636761 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.636652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-config\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.636761 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.636686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-serving-cert\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.636761 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.636723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-oauth-serving-cert\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.636761 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.636758 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-trusted-ca-bundle\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.636972 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.636803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-service-ca\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.672228 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.672196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:20:52.726921 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.726892 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:20:52.738150 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.738085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-service-ca\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.738150 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.738126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lq6g\" (UniqueName: \"kubernetes.io/projected/e0c440c9-54f5-4fe6-9029-119328cfcbfc-kube-api-access-2lq6g\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.738286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.738161 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-oauth-config\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.738286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.738178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-config\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.738286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.738201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-serving-cert\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.738286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.738223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-oauth-serving-cert\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.738286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.738248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-trusted-ca-bundle\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.738926 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.738904 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-config\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.739043 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.739008 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-oauth-serving-cert\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.739116 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.739074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-service-ca\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.739338 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.739317 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-trusted-ca-bundle\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.741165 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.741143 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-oauth-config\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.741396 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.741373 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-serving-cert\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.746192 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.746170 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lq6g\" (UniqueName: \"kubernetes.io/projected/e0c440c9-54f5-4fe6-9029-119328cfcbfc-kube-api-access-2lq6g\") pod \"console-855664f957-k7td8\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.797187 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.797150 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855664f957-k7td8" Jul 24 03:20:52.920265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:52.920243 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-855664f957-k7td8"] Jul 24 03:20:52.922289 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:20:52.922262 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c440c9_54f5_4fe6_9029_119328cfcbfc.slice/crio-1df0918f9dcef59fba6a795a68c8b533abdca7ad5c84183beba762856bef5e88 WatchSource:0}: Error finding container 1df0918f9dcef59fba6a795a68c8b533abdca7ad5c84183beba762856bef5e88: Status 404 returned error can't find the container with id 1df0918f9dcef59fba6a795a68c8b533abdca7ad5c84183beba762856bef5e88 Jul 24 03:20:53.282096 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:53.282064 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:20:53.750420 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:53.750385 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855664f957-k7td8" event={"ID":"e0c440c9-54f5-4fe6-9029-119328cfcbfc","Type":"ContainerStarted","Data":"352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478"} Jul 24 03:20:53.750884 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:53.750445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855664f957-k7td8" event={"ID":"e0c440c9-54f5-4fe6-9029-119328cfcbfc","Type":"ContainerStarted","Data":"1df0918f9dcef59fba6a795a68c8b533abdca7ad5c84183beba762856bef5e88"} Jul 24 03:20:53.768402 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:20:53.768351 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-855664f957-k7td8" podStartSLOduration=1.768333765 podStartE2EDuration="1.768333765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:20:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:20:53.766399249 +0000 UTC m=+157.265902590" watchObservedRunningTime="2026-07-24 03:20:53.768333765 +0000 UTC m=+157.267837105" Jul 24 03:21:02.798212 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:02.798173 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-855664f957-k7td8" Jul 24 03:21:02.798733 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:02.798259 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-855664f957-k7td8" Jul 24 03:21:02.803011 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:02.802988 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-855664f957-k7td8" Jul 24 03:21:03.793992 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:03.793968 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-855664f957-k7td8" Jul 24 03:21:03.944378 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:03.944342 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:04.044793 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:04.044709 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:04.142925 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:04.142898 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:10.552387 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:10.552311 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:17.056201 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:17.056165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:28.598591 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:28.598554 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:28.651940 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:28.651906 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:57.571266 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:57.571231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:58.421562 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:58.421528 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:21:58.482762 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:21:58.482731 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:01.968787 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:01.968753 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c58ff4df4-2s756"] Jul 24 03:22:01.971907 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:01.971886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:01.985906 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:01.985878 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c58ff4df4-2s756"] Jul 24 03:22:02.035418 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.035377 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:02.066675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.066641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-oauth-config\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.066675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.066680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-oauth-serving-cert\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.066841 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.066706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-service-ca\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.066841 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.066796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-trusted-ca-bundle\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.066841 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.066835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-config\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.066936 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.066870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-serving-cert\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.066936 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.066902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4qnt\" (UniqueName: \"kubernetes.io/projected/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-kube-api-access-v4qnt\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.102720 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.102684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:02.168240 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.168191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-service-ca\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.168474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.168251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-trusted-ca-bundle\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.168474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.168284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-config\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.168474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.168346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-serving-cert\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.168474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.168380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4qnt\" (UniqueName: \"kubernetes.io/projected/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-kube-api-access-v4qnt\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.168474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.168414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-oauth-config\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.168474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.168435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-oauth-serving-cert\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.169115 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.169087 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-service-ca\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.169252 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.169166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-config\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.169344 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.169262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-oauth-serving-cert\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.169344 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.169282 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-trusted-ca-bundle\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.170918 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.170887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-oauth-config\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.171004 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.170944 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-serving-cert\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.179200 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.179179 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4qnt\" (UniqueName: \"kubernetes.io/projected/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-kube-api-access-v4qnt\") pod \"console-6c58ff4df4-2s756\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.281017 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.280927 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:02.416997 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.416960 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c58ff4df4-2s756"] Jul 24 03:22:02.420941 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:22:02.420914 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0fe1e5_bb72_4ee9_abdf_08d22b439ce4.slice/crio-644da933c1052a744165b9cfa2f0780460a4c75e4abfd16f778d03fe9dac3fd3 WatchSource:0}: Error finding container 644da933c1052a744165b9cfa2f0780460a4c75e4abfd16f778d03fe9dac3fd3: Status 404 returned error can't find the container with id 644da933c1052a744165b9cfa2f0780460a4c75e4abfd16f778d03fe9dac3fd3 Jul 24 03:22:02.995572 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.995533 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c58ff4df4-2s756" event={"ID":"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4","Type":"ContainerStarted","Data":"b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61"} Jul 24 03:22:02.995985 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:02.995587 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c58ff4df4-2s756" event={"ID":"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4","Type":"ContainerStarted","Data":"644da933c1052a744165b9cfa2f0780460a4c75e4abfd16f778d03fe9dac3fd3"} Jul 24 03:22:03.014345 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:03.014256 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c58ff4df4-2s756" podStartSLOduration=2.014238352 podStartE2EDuration="2.014238352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:22:03.012914432 +0000 UTC m=+226.512417811" watchObservedRunningTime="2026-07-24 03:22:03.014238352 +0000 UTC m=+226.513741691" Jul 24 03:22:10.423876 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:10.423835 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:10.477931 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:10.477887 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:12.281689 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:12.281633 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:12.282117 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:12.281736 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:12.286410 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:12.286388 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:13.034451 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:13.034419 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:22:13.077986 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:13.077948 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-855664f957-k7td8"] Jul 24 03:22:13.183226 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:13.183189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:13.283215 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:13.283172 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:13.390492 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:13.390457 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:13.457391 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:13.457359 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:14.096857 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:14.096822 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:14.197857 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:14.197824 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:15.795980 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:15.795943 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:15.888397 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:15.888365 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:32.550039 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.550002 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq"] Jul 24 03:22:32.553278 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.553258 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" Jul 24 03:22:32.556331 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.556306 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-75l9w\"" Jul 24 03:22:32.557345 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.557322 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 24 03:22:32.557457 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.557328 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 03:22:32.557457 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.557359 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 03:22:32.557457 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.557333 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 03:22:32.561281 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.561255 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:32.561401 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.561380 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq"] Jul 24 03:22:32.610107 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.610067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67e19fb7-eafc-4a26-9050-db1af2ef37e8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84b49897f4-q2wxq\" (UID: \"67e19fb7-eafc-4a26-9050-db1af2ef37e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" Jul 24 03:22:32.610107 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.610122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gplff\" (UniqueName: \"kubernetes.io/projected/67e19fb7-eafc-4a26-9050-db1af2ef37e8-kube-api-access-gplff\") pod \"managed-serviceaccount-addon-agent-84b49897f4-q2wxq\" (UID: \"67e19fb7-eafc-4a26-9050-db1af2ef37e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" Jul 24 03:22:32.632203 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.632173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:32.635747 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.635724 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf"] Jul 24 03:22:32.638634 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.638616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.641321 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.641289 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 24 03:22:32.648822 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.648800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf"] Jul 24 03:22:32.711450 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.711407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8083a89b-f878-4bde-a505-9020cbbf7ad3-klusterlet-config\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.711450 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.711446 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlv8\" (UniqueName: \"kubernetes.io/projected/8083a89b-f878-4bde-a505-9020cbbf7ad3-kube-api-access-shlv8\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.711664 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.711481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67e19fb7-eafc-4a26-9050-db1af2ef37e8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84b49897f4-q2wxq\" (UID: \"67e19fb7-eafc-4a26-9050-db1af2ef37e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" Jul 24 03:22:32.711664 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.711527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8083a89b-f878-4bde-a505-9020cbbf7ad3-tmp\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.711664 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.711587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gplff\" (UniqueName: \"kubernetes.io/projected/67e19fb7-eafc-4a26-9050-db1af2ef37e8-kube-api-access-gplff\") pod \"managed-serviceaccount-addon-agent-84b49897f4-q2wxq\" (UID: \"67e19fb7-eafc-4a26-9050-db1af2ef37e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" Jul 24 03:22:32.713914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.713885 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67e19fb7-eafc-4a26-9050-db1af2ef37e8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84b49897f4-q2wxq\" (UID: \"67e19fb7-eafc-4a26-9050-db1af2ef37e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" Jul 24 03:22:32.720108 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.720087 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gplff\" (UniqueName: \"kubernetes.io/projected/67e19fb7-eafc-4a26-9050-db1af2ef37e8-kube-api-access-gplff\") pod \"managed-serviceaccount-addon-agent-84b49897f4-q2wxq\" (UID: \"67e19fb7-eafc-4a26-9050-db1af2ef37e8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" Jul 24 03:22:32.732813 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.732788 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:22:32.812629 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.812601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8083a89b-f878-4bde-a505-9020cbbf7ad3-tmp\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.812793 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.812668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8083a89b-f878-4bde-a505-9020cbbf7ad3-klusterlet-config\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.812793 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.812690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlv8\" (UniqueName: \"kubernetes.io/projected/8083a89b-f878-4bde-a505-9020cbbf7ad3-kube-api-access-shlv8\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.812984 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.812964 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8083a89b-f878-4bde-a505-9020cbbf7ad3-tmp\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.815123 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.815098 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8083a89b-f878-4bde-a505-9020cbbf7ad3-klusterlet-config\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.823527 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.823503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlv8\" (UniqueName: \"kubernetes.io/projected/8083a89b-f878-4bde-a505-9020cbbf7ad3-kube-api-access-shlv8\") pod \"klusterlet-addon-workmgr-7975cdd898-phsjf\" (UID: \"8083a89b-f878-4bde-a505-9020cbbf7ad3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:32.874518 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.874473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" Jul 24 03:22:32.947880 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:32.947847 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:33.010507 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:33.010473 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq"] Jul 24 03:22:33.014001 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:22:33.013963 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67e19fb7_eafc_4a26_9050_db1af2ef37e8.slice/crio-382f3fe11dde582b2e9bf736cf0da4fe02cca66f1ad1f91a99f4cf4538e2abda WatchSource:0}: Error finding container 382f3fe11dde582b2e9bf736cf0da4fe02cca66f1ad1f91a99f4cf4538e2abda: Status 404 returned error can't find the container with id 382f3fe11dde582b2e9bf736cf0da4fe02cca66f1ad1f91a99f4cf4538e2abda Jul 24 03:22:33.082632 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:33.082609 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf"] Jul 24 03:22:33.085311 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:22:33.085272 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8083a89b_f878_4bde_a505_9020cbbf7ad3.slice/crio-a9761737da533c76dca5c19c61787564eb9fd7cb975a503c63e82e8dcf9eeba7 WatchSource:0}: Error finding container a9761737da533c76dca5c19c61787564eb9fd7cb975a503c63e82e8dcf9eeba7: Status 404 returned error can't find the container with id a9761737da533c76dca5c19c61787564eb9fd7cb975a503c63e82e8dcf9eeba7 Jul 24 03:22:33.100596 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:33.100563 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" event={"ID":"67e19fb7-eafc-4a26-9050-db1af2ef37e8","Type":"ContainerStarted","Data":"382f3fe11dde582b2e9bf736cf0da4fe02cca66f1ad1f91a99f4cf4538e2abda"} Jul 24 03:22:33.101615 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:33.101592 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" event={"ID":"8083a89b-f878-4bde-a505-9020cbbf7ad3","Type":"ContainerStarted","Data":"a9761737da533c76dca5c19c61787564eb9fd7cb975a503c63e82e8dcf9eeba7"} Jul 24 03:22:38.102327 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.102263 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-855664f957-k7td8" podUID="e0c440c9-54f5-4fe6-9029-119328cfcbfc" containerName="console" containerID="cri-o://352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478" gracePeriod=15 Jul 24 03:22:38.125928 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.125901 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" event={"ID":"8083a89b-f878-4bde-a505-9020cbbf7ad3","Type":"ContainerStarted","Data":"f5d5b78c43692175b09b44f45bdfbd997b2a77ed87300c10ae94f43f08b0c232"} Jul 24 03:22:38.126091 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.126067 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:38.127503 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.127469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" event={"ID":"67e19fb7-eafc-4a26-9050-db1af2ef37e8","Type":"ContainerStarted","Data":"c099ce72f0d3dd2384c09c11cec11ba975923bf65efa5dbb8b610f3e3dcb1cbd"} Jul 24 03:22:38.128038 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.128021 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" Jul 24 03:22:38.142424 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.142380 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975cdd898-phsjf" podStartSLOduration=2.136380179 podStartE2EDuration="6.142365989s" totalImagesPullingTime="4.00598581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:22:38.141522587 +0000 UTC m=+261.641025927" watchObservedRunningTime="2026-07-24 03:22:38.142365989 +0000 UTC m=+261.641869307" Jul 24 03:22:38.156054 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.156004 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b49897f4-q2wxq" podStartSLOduration=2.090145971 podStartE2EDuration="6.155988281s" totalImagesPullingTime="4.06584231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:22:38.155819042 +0000 UTC m=+261.655322382" watchObservedRunningTime="2026-07-24 03:22:38.155988281 +0000 UTC m=+261.655491620" Jul 24 03:22:38.345703 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.345678 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855664f957-k7td8" Jul 24 03:22:38.463609 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.463522 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-config\") pod \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " Jul 24 03:22:38.463609 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.463585 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-service-ca\") pod \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " Jul 24 03:22:38.463823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.463630 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-trusted-ca-bundle\") pod \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " Jul 24 03:22:38.463823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.463653 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-oauth-config\") pod \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " Jul 24 03:22:38.463823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.463674 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lq6g\" (UniqueName: \"kubernetes.io/projected/e0c440c9-54f5-4fe6-9029-119328cfcbfc-kube-api-access-2lq6g\") pod \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " Jul 24 03:22:38.463823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.463697 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-oauth-serving-cert\") pod \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " Jul 24 03:22:38.463823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.463729 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-serving-cert\") pod \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\" (UID: \"e0c440c9-54f5-4fe6-9029-119328cfcbfc\") " Jul 24 03:22:38.465016 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.464995 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e0c440c9-54f5-4fe6-9029-119328cfcbfc" (UID: "e0c440c9-54f5-4fe6-9029-119328cfcbfc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:22:38.466358 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.466325 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0c440c9-54f5-4fe6-9029-119328cfcbfc" (UID: "e0c440c9-54f5-4fe6-9029-119328cfcbfc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:22:38.466484 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.466441 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0c440c9-54f5-4fe6-9029-119328cfcbfc" (UID: "e0c440c9-54f5-4fe6-9029-119328cfcbfc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:22:38.466804 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.466783 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0c440c9-54f5-4fe6-9029-119328cfcbfc" (UID: "e0c440c9-54f5-4fe6-9029-119328cfcbfc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:22:38.466874 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.466816 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-config" (OuterVolumeSpecName: "console-config") pod "e0c440c9-54f5-4fe6-9029-119328cfcbfc" (UID: "e0c440c9-54f5-4fe6-9029-119328cfcbfc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:22:38.467431 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.467390 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0c440c9-54f5-4fe6-9029-119328cfcbfc" (UID: "e0c440c9-54f5-4fe6-9029-119328cfcbfc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:22:38.468519 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.468501 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c440c9-54f5-4fe6-9029-119328cfcbfc-kube-api-access-2lq6g" (OuterVolumeSpecName: "kube-api-access-2lq6g") pod "e0c440c9-54f5-4fe6-9029-119328cfcbfc" (UID: "e0c440c9-54f5-4fe6-9029-119328cfcbfc"). InnerVolumeSpecName "kube-api-access-2lq6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:22:38.565177 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.565139 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lq6g\" (UniqueName: \"kubernetes.io/projected/e0c440c9-54f5-4fe6-9029-119328cfcbfc-kube-api-access-2lq6g\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:22:38.565177 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.565168 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-oauth-serving-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:22:38.565177 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.565178 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-serving-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:22:38.565177 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.565187 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-config\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:22:38.565466 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.565195 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-service-ca\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:22:38.565466 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.565203 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c440c9-54f5-4fe6-9029-119328cfcbfc-trusted-ca-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:22:38.565466 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:38.565211 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0c440c9-54f5-4fe6-9029-119328cfcbfc-console-oauth-config\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:22:39.131980 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.131947 2564 generic.go:356] "Generic (PLEG): container finished" podID="e0c440c9-54f5-4fe6-9029-119328cfcbfc" containerID="352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478" exitCode=0 Jul 24 03:22:39.132454 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.131992 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855664f957-k7td8" Jul 24 03:22:39.132454 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.132031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855664f957-k7td8" event={"ID":"e0c440c9-54f5-4fe6-9029-119328cfcbfc","Type":"ContainerDied","Data":"352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478"} Jul 24 03:22:39.132454 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.132080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855664f957-k7td8" event={"ID":"e0c440c9-54f5-4fe6-9029-119328cfcbfc","Type":"ContainerDied","Data":"1df0918f9dcef59fba6a795a68c8b533abdca7ad5c84183beba762856bef5e88"} Jul 24 03:22:39.132454 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.132101 2564 scope.go:117] "RemoveContainer" containerID="352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478" Jul 24 03:22:39.140381 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.140365 2564 scope.go:117] "RemoveContainer" containerID="352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478" Jul 24 03:22:39.140659 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:22:39.140640 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478\": container with ID starting with 352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478 not found: ID does not exist" containerID="352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478" Jul 24 03:22:39.140710 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.140668 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478"} err="failed to get container status \"352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478\": rpc error: code = NotFound desc = could not find container \"352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478\": container with ID starting with 352c93d7e1782317a6ae4b29903ccc31d57793ce5d42bda5cdca563ea75c6478 not found: ID does not exist" Jul 24 03:22:39.147421 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.147386 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-855664f957-k7td8"] Jul 24 03:22:39.151061 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:39.151039 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-855664f957-k7td8"] Jul 24 03:22:41.050095 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:22:41.050058 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0c440c9-54f5-4fe6-9029-119328cfcbfc" path="/var/lib/kubelet/pods/e0c440c9-54f5-4fe6-9029-119328cfcbfc/volumes" Jul 24 03:23:02.482111 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:02.482077 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:03.274347 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.274315 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9"] Jul 24 03:23:03.274625 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.274604 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0c440c9-54f5-4fe6-9029-119328cfcbfc" containerName="console" Jul 24 03:23:03.274625 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.274618 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c440c9-54f5-4fe6-9029-119328cfcbfc" containerName="console" Jul 24 03:23:03.274737 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.274726 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0c440c9-54f5-4fe6-9029-119328cfcbfc" containerName="console" Jul 24 03:23:03.280667 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.280638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.283283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.283259 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 03:23:03.283445 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.283259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqdvv\"" Jul 24 03:23:03.283445 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.283259 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 03:23:03.288213 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.288188 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9"] Jul 24 03:23:03.376147 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.376112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.376147 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.376148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.376420 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.376183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvsff\" (UniqueName: \"kubernetes.io/projected/4d1860fc-bf83-47eb-9e68-eb9f7f923363-kube-api-access-xvsff\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.476750 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.476710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.476750 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.476749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.476959 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.476781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvsff\" (UniqueName: \"kubernetes.io/projected/4d1860fc-bf83-47eb-9e68-eb9f7f923363-kube-api-access-xvsff\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.477193 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.477170 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.477230 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.477189 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.484607 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.484576 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvsff\" (UniqueName: \"kubernetes.io/projected/4d1860fc-bf83-47eb-9e68-eb9f7f923363-kube-api-access-xvsff\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.582563 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.582529 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:03.589829 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.589797 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:03.720442 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:03.720417 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9"] Jul 24 03:23:03.724406 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:23:03.724364 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1860fc_bf83_47eb_9e68_eb9f7f923363.slice/crio-06f3a88118ed5ccef6b5cefc6348981cc7d41817858194e9c78fa82321f1f4e4 WatchSource:0}: Error finding container 06f3a88118ed5ccef6b5cefc6348981cc7d41817858194e9c78fa82321f1f4e4: Status 404 returned error can't find the container with id 06f3a88118ed5ccef6b5cefc6348981cc7d41817858194e9c78fa82321f1f4e4 Jul 24 03:23:04.228993 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:04.228956 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" event={"ID":"4d1860fc-bf83-47eb-9e68-eb9f7f923363","Type":"ContainerStarted","Data":"06f3a88118ed5ccef6b5cefc6348981cc7d41817858194e9c78fa82321f1f4e4"} Jul 24 03:23:11.258756 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:11.258662 2564 generic.go:356] "Generic (PLEG): container finished" podID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerID="aedb3edcbaa54a36a22921924e3495809650251ea5b2cb5d6214afeee3cddaf7" exitCode=0 Jul 24 03:23:11.258756 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:11.258730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" event={"ID":"4d1860fc-bf83-47eb-9e68-eb9f7f923363","Type":"ContainerDied","Data":"aedb3edcbaa54a36a22921924e3495809650251ea5b2cb5d6214afeee3cddaf7"} Jul 24 03:23:14.273041 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:14.273000 2564 generic.go:356] "Generic (PLEG): container finished" podID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerID="6a637da37f334cda4cf4ee37ef8120c652b1628a4a48a100073080cc5543a8c5" exitCode=0 Jul 24 03:23:14.273041 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:14.273042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" event={"ID":"4d1860fc-bf83-47eb-9e68-eb9f7f923363","Type":"ContainerDied","Data":"6a637da37f334cda4cf4ee37ef8120c652b1628a4a48a100073080cc5543a8c5"} Jul 24 03:23:16.934703 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:16.934674 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 03:23:21.304655 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:21.304618 2564 generic.go:356] "Generic (PLEG): container finished" podID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerID="c90e278c81ff5b2a7ded723ae196f4800ff5768d89776aa171a9b7d1f177ddd3" exitCode=0 Jul 24 03:23:21.305095 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:21.304664 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" event={"ID":"4d1860fc-bf83-47eb-9e68-eb9f7f923363","Type":"ContainerDied","Data":"c90e278c81ff5b2a7ded723ae196f4800ff5768d89776aa171a9b7d1f177ddd3"} Jul 24 03:23:22.431060 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.431035 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:22.532854 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.532812 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-bundle\") pod \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " Jul 24 03:23:22.533057 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.532898 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-util\") pod \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " Jul 24 03:23:22.533057 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.532926 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvsff\" (UniqueName: \"kubernetes.io/projected/4d1860fc-bf83-47eb-9e68-eb9f7f923363-kube-api-access-xvsff\") pod \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\" (UID: \"4d1860fc-bf83-47eb-9e68-eb9f7f923363\") " Jul 24 03:23:22.533525 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.533503 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-bundle" (OuterVolumeSpecName: "bundle") pod "4d1860fc-bf83-47eb-9e68-eb9f7f923363" (UID: "4d1860fc-bf83-47eb-9e68-eb9f7f923363"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:23:22.535100 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.535071 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1860fc-bf83-47eb-9e68-eb9f7f923363-kube-api-access-xvsff" (OuterVolumeSpecName: "kube-api-access-xvsff") pod "4d1860fc-bf83-47eb-9e68-eb9f7f923363" (UID: "4d1860fc-bf83-47eb-9e68-eb9f7f923363"). InnerVolumeSpecName "kube-api-access-xvsff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:23:22.538808 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.538782 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-util" (OuterVolumeSpecName: "util") pod "4d1860fc-bf83-47eb-9e68-eb9f7f923363" (UID: "4d1860fc-bf83-47eb-9e68-eb9f7f923363"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:23:22.633669 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.633623 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-util\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:22.633669 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.633666 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvsff\" (UniqueName: \"kubernetes.io/projected/4d1860fc-bf83-47eb-9e68-eb9f7f923363-kube-api-access-xvsff\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:22.633669 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:22.633678 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1860fc-bf83-47eb-9e68-eb9f7f923363-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:23.313047 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:23.313018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" event={"ID":"4d1860fc-bf83-47eb-9e68-eb9f7f923363","Type":"ContainerDied","Data":"06f3a88118ed5ccef6b5cefc6348981cc7d41817858194e9c78fa82321f1f4e4"} Jul 24 03:23:23.313202 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:23.313055 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540scww9" Jul 24 03:23:23.313202 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:23.313070 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06f3a88118ed5ccef6b5cefc6348981cc7d41817858194e9c78fa82321f1f4e4" Jul 24 03:23:29.305109 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:29.305078 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:30.127539 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:30.127503 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:31.274634 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.274599 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g"] Jul 24 03:23:31.275005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.274879 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerName="util" Jul 24 03:23:31.275005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.274890 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerName="util" Jul 24 03:23:31.275005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.274903 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerName="pull" Jul 24 03:23:31.275005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.274909 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerName="pull" Jul 24 03:23:31.275005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.274917 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerName="extract" Jul 24 03:23:31.275005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.274923 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerName="extract" Jul 24 03:23:31.275005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.274964 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d1860fc-bf83-47eb-9e68-eb9f7f923363" containerName="extract" Jul 24 03:23:31.277138 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.277121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" Jul 24 03:23:31.281797 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.281773 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lmq8s\"" Jul 24 03:23:31.281797 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.281797 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:23:31.281997 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.281824 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 24 03:23:31.293317 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.293266 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g"] Jul 24 03:23:31.403979 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.403946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5f1b809-b841-4930-9ddd-c144962fb0da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kp96g\" (UID: \"c5f1b809-b841-4930-9ddd-c144962fb0da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" Jul 24 03:23:31.404158 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.403999 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn9vn\" (UniqueName: \"kubernetes.io/projected/c5f1b809-b841-4930-9ddd-c144962fb0da-kube-api-access-wn9vn\") pod \"cert-manager-operator-controller-manager-55c444bf86-kp96g\" (UID: \"c5f1b809-b841-4930-9ddd-c144962fb0da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" Jul 24 03:23:31.504777 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.504738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5f1b809-b841-4930-9ddd-c144962fb0da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kp96g\" (UID: \"c5f1b809-b841-4930-9ddd-c144962fb0da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" Jul 24 03:23:31.504970 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.504804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn9vn\" (UniqueName: \"kubernetes.io/projected/c5f1b809-b841-4930-9ddd-c144962fb0da-kube-api-access-wn9vn\") pod \"cert-manager-operator-controller-manager-55c444bf86-kp96g\" (UID: \"c5f1b809-b841-4930-9ddd-c144962fb0da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" Jul 24 03:23:31.505142 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.505122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5f1b809-b841-4930-9ddd-c144962fb0da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kp96g\" (UID: \"c5f1b809-b841-4930-9ddd-c144962fb0da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" Jul 24 03:23:31.525826 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.525764 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn9vn\" (UniqueName: \"kubernetes.io/projected/c5f1b809-b841-4930-9ddd-c144962fb0da-kube-api-access-wn9vn\") pod \"cert-manager-operator-controller-manager-55c444bf86-kp96g\" (UID: \"c5f1b809-b841-4930-9ddd-c144962fb0da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" Jul 24 03:23:31.585738 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.585704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" Jul 24 03:23:31.726353 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.726329 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g"] Jul 24 03:23:31.728796 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:23:31.728771 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f1b809_b841_4930_9ddd_c144962fb0da.slice/crio-20134be9bb85e935613599558ab2d1958fb2a3547d49ce7a43830697ff6b9b11 WatchSource:0}: Error finding container 20134be9bb85e935613599558ab2d1958fb2a3547d49ce7a43830697ff6b9b11: Status 404 returned error can't find the container with id 20134be9bb85e935613599558ab2d1958fb2a3547d49ce7a43830697ff6b9b11 Jul 24 03:23:31.731507 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:31.731492 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 03:23:32.352717 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:32.352684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" event={"ID":"c5f1b809-b841-4930-9ddd-c144962fb0da","Type":"ContainerStarted","Data":"20134be9bb85e935613599558ab2d1958fb2a3547d49ce7a43830697ff6b9b11"} Jul 24 03:23:32.921147 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:32.921114 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:33.021908 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:33.021875 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:34.264465 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:34.264429 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:34.367801 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:34.367766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" event={"ID":"c5f1b809-b841-4930-9ddd-c144962fb0da","Type":"ContainerStarted","Data":"8c1ea15cd698766a02b703be589d2be1f14600119e564a45daece47ae730dfde"} Jul 24 03:23:34.377202 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:34.377166 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:34.393225 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:34.393176 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kp96g" podStartSLOduration=1.5909876509999998 podStartE2EDuration="3.393158531s" totalImagesPullingTime="1.80217088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:23:34.391091795 +0000 UTC m=+317.890595157" watchObservedRunningTime="2026-07-24 03:23:34.393158531 +0000 UTC m=+317.892661882" Jul 24 03:23:34.745484 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:34.745445 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:34.840978 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:34.840941 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:35.336325 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.336279 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds"] Jul 24 03:23:35.339958 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.339941 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.342536 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.342505 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 03:23:35.342536 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.342507 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 03:23:35.342693 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.342511 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqdvv\"" Jul 24 03:23:35.348006 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.347984 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds"] Jul 24 03:23:35.436754 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.436718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.436754 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.436759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.436978 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.436806 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg6xd\" (UniqueName: \"kubernetes.io/projected/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-kube-api-access-vg6xd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.537975 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.537930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.538170 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.537985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.538170 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.538027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg6xd\" (UniqueName: \"kubernetes.io/projected/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-kube-api-access-vg6xd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.538335 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.538281 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.538446 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.538372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.546516 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.546486 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg6xd\" (UniqueName: \"kubernetes.io/projected/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-kube-api-access-vg6xd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.650355 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.650240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:35.777398 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:35.777374 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds"] Jul 24 03:23:35.780062 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:23:35.780036 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d36a70_5a1f_4bc7_81ef_8ee4ab75e7ee.slice/crio-805a4c61051201ac424b470ba68eeca1086e2efc0fa96165e980bef336ac7b58 WatchSource:0}: Error finding container 805a4c61051201ac424b470ba68eeca1086e2efc0fa96165e980bef336ac7b58: Status 404 returned error can't find the container with id 805a4c61051201ac424b470ba68eeca1086e2efc0fa96165e980bef336ac7b58 Jul 24 03:23:36.377105 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:36.377070 2564 generic.go:356] "Generic (PLEG): container finished" podID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerID="71d5df74cae5f1fb54ae54da15c8497f4a11cb9d898704b7c68e4c2347ef2920" exitCode=0 Jul 24 03:23:36.377558 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:36.377160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" event={"ID":"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee","Type":"ContainerDied","Data":"71d5df74cae5f1fb54ae54da15c8497f4a11cb9d898704b7c68e4c2347ef2920"} Jul 24 03:23:36.377558 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:36.377222 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" event={"ID":"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee","Type":"ContainerStarted","Data":"805a4c61051201ac424b470ba68eeca1086e2efc0fa96165e980bef336ac7b58"} Jul 24 03:23:36.676459 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:36.676351 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:36.879970 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:36.879942 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:38.387068 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:38.387028 2564 generic.go:356] "Generic (PLEG): container finished" podID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerID="460d36261cf64637429483aed99b582378a744e2c3bfeeaec2aa8f66a4490a59" exitCode=0 Jul 24 03:23:38.387488 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:38.387095 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" event={"ID":"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee","Type":"ContainerDied","Data":"460d36261cf64637429483aed99b582378a744e2c3bfeeaec2aa8f66a4490a59"} Jul 24 03:23:39.392898 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:39.392864 2564 generic.go:356] "Generic (PLEG): container finished" podID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerID="2781fd6c6a9c3b7c9393889dae610f434185479f847bf402ef494e9d3e9a1f22" exitCode=0 Jul 24 03:23:39.393316 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:39.392960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" event={"ID":"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee","Type":"ContainerDied","Data":"2781fd6c6a9c3b7c9393889dae610f434185479f847bf402ef494e9d3e9a1f22"} Jul 24 03:23:39.713251 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:39.713148 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:39.769164 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:39.769127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:40.522353 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.522329 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:40.580572 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.580541 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-bundle\") pod \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " Jul 24 03:23:40.580748 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.580597 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-util\") pod \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " Jul 24 03:23:40.580748 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.580694 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg6xd\" (UniqueName: \"kubernetes.io/projected/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-kube-api-access-vg6xd\") pod \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\" (UID: \"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee\") " Jul 24 03:23:40.581006 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.580979 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-bundle" (OuterVolumeSpecName: "bundle") pod "39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" (UID: "39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:23:40.582840 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.582813 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-kube-api-access-vg6xd" (OuterVolumeSpecName: "kube-api-access-vg6xd") pod "39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" (UID: "39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee"). InnerVolumeSpecName "kube-api-access-vg6xd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:23:40.589392 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.589361 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-util" (OuterVolumeSpecName: "util") pod "39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" (UID: "39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:23:40.681468 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.681369 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:40.681468 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.681411 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-util\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:40.681468 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:40.681421 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg6xd\" (UniqueName: \"kubernetes.io/projected/39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee-kube-api-access-vg6xd\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:41.406620 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:41.406582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" event={"ID":"39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee","Type":"ContainerDied","Data":"805a4c61051201ac424b470ba68eeca1086e2efc0fa96165e980bef336ac7b58"} Jul 24 03:23:41.406769 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:41.406628 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lhds" Jul 24 03:23:41.406769 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:41.406636 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="805a4c61051201ac424b470ba68eeca1086e2efc0fa96165e980bef336ac7b58" Jul 24 03:23:42.052782 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.052747 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-d4djf"] Jul 24 03:23:42.053231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.053014 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerName="pull" Jul 24 03:23:42.053231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.053025 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerName="pull" Jul 24 03:23:42.053231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.053041 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerName="util" Jul 24 03:23:42.053231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.053046 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerName="util" Jul 24 03:23:42.053231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.053055 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerName="extract" Jul 24 03:23:42.053231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.053061 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerName="extract" Jul 24 03:23:42.053231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.053104 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d36a70-5a1f-4bc7-81ef-8ee4ab75e7ee" containerName="extract" Jul 24 03:23:42.055582 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.055562 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:42.058047 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.058029 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 03:23:42.058143 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.058095 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 03:23:42.058771 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.058754 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b5jfr\"" Jul 24 03:23:42.063644 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.063623 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-d4djf"] Jul 24 03:23:42.190585 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.190548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e66cdec4-110b-4315-a621-10442198e5a5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-d4djf\" (UID: \"e66cdec4-110b-4315-a621-10442198e5a5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:42.190779 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.190603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpr7w\" (UniqueName: \"kubernetes.io/projected/e66cdec4-110b-4315-a621-10442198e5a5-kube-api-access-jpr7w\") pod \"cert-manager-webhook-6486ffd997-d4djf\" (UID: \"e66cdec4-110b-4315-a621-10442198e5a5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:42.291491 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.291457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpr7w\" (UniqueName: \"kubernetes.io/projected/e66cdec4-110b-4315-a621-10442198e5a5-kube-api-access-jpr7w\") pod \"cert-manager-webhook-6486ffd997-d4djf\" (UID: \"e66cdec4-110b-4315-a621-10442198e5a5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:42.291672 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.291526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e66cdec4-110b-4315-a621-10442198e5a5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-d4djf\" (UID: \"e66cdec4-110b-4315-a621-10442198e5a5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:42.298894 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.298869 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e66cdec4-110b-4315-a621-10442198e5a5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-d4djf\" (UID: \"e66cdec4-110b-4315-a621-10442198e5a5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:42.299177 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.299155 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpr7w\" (UniqueName: \"kubernetes.io/projected/e66cdec4-110b-4315-a621-10442198e5a5-kube-api-access-jpr7w\") pod \"cert-manager-webhook-6486ffd997-d4djf\" (UID: \"e66cdec4-110b-4315-a621-10442198e5a5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:42.365131 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.365083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:42.494706 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:42.494656 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-d4djf"] Jul 24 03:23:42.496888 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:23:42.496859 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode66cdec4_110b_4315_a621_10442198e5a5.slice/crio-bf2429c965b20ef757dd59c2f2d45b3991a5696442828d6850dbf2b04054b88f WatchSource:0}: Error finding container bf2429c965b20ef757dd59c2f2d45b3991a5696442828d6850dbf2b04054b88f: Status 404 returned error can't find the container with id bf2429c965b20ef757dd59c2f2d45b3991a5696442828d6850dbf2b04054b88f Jul 24 03:23:43.315348 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:43.315312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:43.412005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:43.411969 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:43.416520 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:43.416494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" event={"ID":"e66cdec4-110b-4315-a621-10442198e5a5","Type":"ContainerStarted","Data":"bf2429c965b20ef757dd59c2f2d45b3991a5696442828d6850dbf2b04054b88f"} Jul 24 03:23:43.886757 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:43.886725 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:45.341667 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.341625 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6"] Jul 24 03:23:45.358114 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.358075 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6"] Jul 24 03:23:45.358352 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.358218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" Jul 24 03:23:45.361046 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.360860 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:23:45.361046 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.360986 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 03:23:45.361821 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.361797 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kqv6q\"" Jul 24 03:23:45.420885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.420853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b5f03c4-66bd-442a-8d9f-ffbfbd55235b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5bcg6\" (UID: \"4b5f03c4-66bd-442a-8d9f-ffbfbd55235b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" Jul 24 03:23:45.421073 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.420947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxscj\" (UniqueName: \"kubernetes.io/projected/4b5f03c4-66bd-442a-8d9f-ffbfbd55235b-kube-api-access-mxscj\") pod \"openshift-lws-operator-fd8ccff4c-5bcg6\" (UID: \"4b5f03c4-66bd-442a-8d9f-ffbfbd55235b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" Jul 24 03:23:45.521474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.521438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxscj\" (UniqueName: \"kubernetes.io/projected/4b5f03c4-66bd-442a-8d9f-ffbfbd55235b-kube-api-access-mxscj\") pod \"openshift-lws-operator-fd8ccff4c-5bcg6\" (UID: \"4b5f03c4-66bd-442a-8d9f-ffbfbd55235b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" Jul 24 03:23:45.521636 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.521513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b5f03c4-66bd-442a-8d9f-ffbfbd55235b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5bcg6\" (UID: \"4b5f03c4-66bd-442a-8d9f-ffbfbd55235b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" Jul 24 03:23:45.521920 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.521897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b5f03c4-66bd-442a-8d9f-ffbfbd55235b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5bcg6\" (UID: \"4b5f03c4-66bd-442a-8d9f-ffbfbd55235b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" Jul 24 03:23:45.529468 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.529443 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxscj\" (UniqueName: \"kubernetes.io/projected/4b5f03c4-66bd-442a-8d9f-ffbfbd55235b-kube-api-access-mxscj\") pod \"openshift-lws-operator-fd8ccff4c-5bcg6\" (UID: \"4b5f03c4-66bd-442a-8d9f-ffbfbd55235b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" Jul 24 03:23:45.670198 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.670173 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" Jul 24 03:23:45.841526 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:45.841500 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6"] Jul 24 03:23:45.843553 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:23:45.843526 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b5f03c4_66bd_442a_8d9f_ffbfbd55235b.slice/crio-4b5ec12bd418729dfed28a86d0a911fa566f6fe291f66c0ba81cc05002d9f2f9 WatchSource:0}: Error finding container 4b5ec12bd418729dfed28a86d0a911fa566f6fe291f66c0ba81cc05002d9f2f9: Status 404 returned error can't find the container with id 4b5ec12bd418729dfed28a86d0a911fa566f6fe291f66c0ba81cc05002d9f2f9 Jul 24 03:23:46.436230 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:46.436196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" event={"ID":"4b5f03c4-66bd-442a-8d9f-ffbfbd55235b","Type":"ContainerStarted","Data":"4b5ec12bd418729dfed28a86d0a911fa566f6fe291f66c0ba81cc05002d9f2f9"} Jul 24 03:23:46.437729 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:46.437702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" event={"ID":"e66cdec4-110b-4315-a621-10442198e5a5","Type":"ContainerStarted","Data":"3ef70e8d8ab24f4446775b99eb0b229ad63994197742481cd60bbc32c68cdc73"} Jul 24 03:23:46.437872 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:46.437809 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:46.453331 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:46.453259 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" podStartSLOduration=1.338700135 podStartE2EDuration="4.453241368s" totalImagesPullingTime="3.114541233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:23:46.452970486 +0000 UTC m=+329.952473826" watchObservedRunningTime="2026-07-24 03:23:46.453241368 +0000 UTC m=+329.952744708" Jul 24 03:23:48.448691 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:48.448657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" event={"ID":"4b5f03c4-66bd-442a-8d9f-ffbfbd55235b","Type":"ContainerStarted","Data":"a1b27bf3f9caa4216724fcd6c64c288dbcdc0651fdcab6057509c21f185e65a0"} Jul 24 03:23:48.466168 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:48.466107 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5bcg6" podStartSLOduration=1.744047955 podStartE2EDuration="3.466084334s" totalImagesPullingTime="1.722036379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:23:48.463356655 +0000 UTC m=+331.962859996" watchObservedRunningTime="2026-07-24 03:23:48.466084334 +0000 UTC m=+331.965587674" Jul 24 03:23:49.082283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:49.082248 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:49.183556 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:49.183514 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:51.009024 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.008992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:51.215042 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.215003 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6"] Jul 24 03:23:51.217482 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.217465 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.219712 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.219693 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqdvv\"" Jul 24 03:23:51.220034 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.220019 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 03:23:51.220567 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.220551 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 03:23:51.225850 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.225831 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6"] Jul 24 03:23:51.373834 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.373796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.373834 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.373842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.374061 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.373914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjqz7\" (UniqueName: \"kubernetes.io/projected/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-kube-api-access-xjqz7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.475045 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.475006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjqz7\" (UniqueName: \"kubernetes.io/projected/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-kube-api-access-xjqz7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.475237 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.475072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.475237 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.475099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.475687 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.475541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.475687 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.475592 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.483328 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.483266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjqz7\" (UniqueName: \"kubernetes.io/projected/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-kube-api-access-xjqz7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.527761 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.527720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:51.668274 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:51.668249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6"] Jul 24 03:23:51.670799 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:23:51.670771 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a9ee94_7c3a_4ad6_97b4_6956c43ae7f0.slice/crio-878da7842d5a87061b35ac3443003b2e2f1ff21fce8047894ea17c6d9e0d5296 WatchSource:0}: Error finding container 878da7842d5a87061b35ac3443003b2e2f1ff21fce8047894ea17c6d9e0d5296: Status 404 returned error can't find the container with id 878da7842d5a87061b35ac3443003b2e2f1ff21fce8047894ea17c6d9e0d5296 Jul 24 03:23:52.445682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:52.445650 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-d4djf" Jul 24 03:23:52.467109 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:52.467073 2564 generic.go:356] "Generic (PLEG): container finished" podID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerID="10a5a2e449474565b34af0a157ba0a31fb96880ef5c6056a5a412a31894561e9" exitCode=0 Jul 24 03:23:52.467274 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:52.467143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" event={"ID":"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0","Type":"ContainerDied","Data":"10a5a2e449474565b34af0a157ba0a31fb96880ef5c6056a5a412a31894561e9"} Jul 24 03:23:52.467274 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:52.467202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" event={"ID":"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0","Type":"ContainerStarted","Data":"878da7842d5a87061b35ac3443003b2e2f1ff21fce8047894ea17c6d9e0d5296"} Jul 24 03:23:54.478812 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:54.478780 2564 generic.go:356] "Generic (PLEG): container finished" podID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerID="fa96dffae681fcfc25cce9605f7cb4048dca8fd87ae700c437cf98373b76a4c7" exitCode=0 Jul 24 03:23:54.479285 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:54.478844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" event={"ID":"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0","Type":"ContainerDied","Data":"fa96dffae681fcfc25cce9605f7cb4048dca8fd87ae700c437cf98373b76a4c7"} Jul 24 03:23:55.489410 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:55.489378 2564 generic.go:356] "Generic (PLEG): container finished" podID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerID="562954b82858a25dd2471e6b062166f6e1232a892f5341561e05bc382204091a" exitCode=0 Jul 24 03:23:55.489823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:55.489464 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" event={"ID":"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0","Type":"ContainerDied","Data":"562954b82858a25dd2471e6b062166f6e1232a892f5341561e05bc382204091a"} Jul 24 03:23:56.616813 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.616786 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:56.723032 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.723001 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-util\") pod \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " Jul 24 03:23:56.723196 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.723046 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-bundle\") pod \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " Jul 24 03:23:56.723196 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.723090 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjqz7\" (UniqueName: \"kubernetes.io/projected/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-kube-api-access-xjqz7\") pod \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\" (UID: \"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0\") " Jul 24 03:23:56.723821 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.723792 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-bundle" (OuterVolumeSpecName: "bundle") pod "d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" (UID: "d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:23:56.725211 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.725191 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-kube-api-access-xjqz7" (OuterVolumeSpecName: "kube-api-access-xjqz7") pod "d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" (UID: "d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0"). InnerVolumeSpecName "kube-api-access-xjqz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:23:56.728412 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.728378 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-util" (OuterVolumeSpecName: "util") pod "d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" (UID: "d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:23:56.823974 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.823938 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:56.823974 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.823973 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjqz7\" (UniqueName: \"kubernetes.io/projected/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-kube-api-access-xjqz7\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:56.823974 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:56.823983 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0-util\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:23:57.499982 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:57.499952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" event={"ID":"d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0","Type":"ContainerDied","Data":"878da7842d5a87061b35ac3443003b2e2f1ff21fce8047894ea17c6d9e0d5296"} Jul 24 03:23:57.500231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:57.499999 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="878da7842d5a87061b35ac3443003b2e2f1ff21fce8047894ea17c6d9e0d5296" Jul 24 03:23:57.500231 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:57.499959 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afs4dt6" Jul 24 03:23:59.365983 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:59.365950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:23:59.436761 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:23:59.436726 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:10.145478 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:10.145394 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:10.257667 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:10.257630 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:10.746347 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:10.746315 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:11.133352 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.133289 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:11.291575 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.291535 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp"] Jul 24 03:24:11.292062 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.291979 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerName="pull" Jul 24 03:24:11.292062 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.291996 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerName="pull" Jul 24 03:24:11.292062 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.292008 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerName="extract" Jul 24 03:24:11.292062 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.292016 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerName="extract" Jul 24 03:24:11.292062 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.292041 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerName="util" Jul 24 03:24:11.292062 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.292049 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerName="util" Jul 24 03:24:11.292389 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.292130 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9a9ee94-7c3a-4ad6-97b4-6956c43ae7f0" containerName="extract" Jul 24 03:24:11.294357 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.294333 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.298686 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.298657 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 03:24:11.299218 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.299197 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 03:24:11.299338 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.299262 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 03:24:11.299338 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.299274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l74m9\"" Jul 24 03:24:11.299582 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.299558 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 03:24:11.338454 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.338415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33fb4595-ddcd-419d-9cb3-8a538698f6c0-manifests\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.338635 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.338464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33fb4595-ddcd-419d-9cb3-8a538698f6c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.338635 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.338511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33fb4595-ddcd-419d-9cb3-8a538698f6c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.338635 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.338572 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksqlp\" (UniqueName: \"kubernetes.io/projected/33fb4595-ddcd-419d-9cb3-8a538698f6c0-kube-api-access-ksqlp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.338635 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.338614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33fb4595-ddcd-419d-9cb3-8a538698f6c0-tmp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.344238 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.344209 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp"] Jul 24 03:24:11.395592 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.395504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:11.439596 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.439563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksqlp\" (UniqueName: \"kubernetes.io/projected/33fb4595-ddcd-419d-9cb3-8a538698f6c0-kube-api-access-ksqlp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.439596 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.439604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33fb4595-ddcd-419d-9cb3-8a538698f6c0-tmp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.439864 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.439803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33fb4595-ddcd-419d-9cb3-8a538698f6c0-manifests\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.439933 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.439868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33fb4595-ddcd-419d-9cb3-8a538698f6c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.439989 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.439927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33fb4595-ddcd-419d-9cb3-8a538698f6c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.440284 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.440258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33fb4595-ddcd-419d-9cb3-8a538698f6c0-manifests\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.442994 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.442770 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33fb4595-ddcd-419d-9cb3-8a538698f6c0-tmp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.442994 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.442925 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33fb4595-ddcd-419d-9cb3-8a538698f6c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.442994 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.442989 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33fb4595-ddcd-419d-9cb3-8a538698f6c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.456789 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.456753 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksqlp\" (UniqueName: \"kubernetes.io/projected/33fb4595-ddcd-419d-9cb3-8a538698f6c0-kube-api-access-ksqlp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-rz2xp\" (UID: \"33fb4595-ddcd-419d-9cb3-8a538698f6c0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.499764 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.499732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:11.604866 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.604829 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:11.619481 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.619447 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk"] Jul 24 03:24:11.621900 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.621885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.624854 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.624834 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8qxrp\"" Jul 24 03:24:11.625129 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.625110 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 03:24:11.625229 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.625212 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 03:24:11.625462 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.625446 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 03:24:11.638349 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.638321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk"] Jul 24 03:24:11.641947 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.641913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-manager-config\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.642095 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.641990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-cert\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.642095 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.642041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-metrics-cert\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.642095 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.642076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jx6n\" (UniqueName: \"kubernetes.io/projected/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-kube-api-access-7jx6n\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.667200 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.667045 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:11.742867 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.742834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-cert\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.743052 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.742882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-metrics-cert\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.743052 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.743014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jx6n\" (UniqueName: \"kubernetes.io/projected/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-kube-api-access-7jx6n\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.743167 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.743118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-manager-config\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.743748 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.743727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-manager-config\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.745589 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.745566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-cert\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.745680 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.745568 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-metrics-cert\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.764039 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.764010 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jx6n\" (UniqueName: \"kubernetes.io/projected/f1e6bbd1-1053-436c-bb1a-72c27c8b2af2-kube-api-access-7jx6n\") pod \"lws-controller-manager-df5f88749-fmlqk\" (UID: \"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2\") " pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:11.776086 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.776060 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp"] Jul 24 03:24:11.778506 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:24:11.778481 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fb4595_ddcd_419d_9cb3_8a538698f6c0.slice/crio-905a90ffcef1e458fa32bbdc564f617268f009f68cbac7cde91cb5be35694ec7 WatchSource:0}: Error finding container 905a90ffcef1e458fa32bbdc564f617268f009f68cbac7cde91cb5be35694ec7: Status 404 returned error can't find the container with id 905a90ffcef1e458fa32bbdc564f617268f009f68cbac7cde91cb5be35694ec7 Jul 24 03:24:11.795522 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.795489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:11.904606 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.904575 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:11.939731 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:11.939644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:12.001720 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:12.001683 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:12.079126 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:12.079099 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk"] Jul 24 03:24:12.080548 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:24:12.080522 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e6bbd1_1053_436c_bb1a_72c27c8b2af2.slice/crio-7789854b1c88ecd1295e64246f03cf69cdb2af03b60d5fa8d5ae9adc7ecdedde WatchSource:0}: Error finding container 7789854b1c88ecd1295e64246f03cf69cdb2af03b60d5fa8d5ae9adc7ecdedde: Status 404 returned error can't find the container with id 7789854b1c88ecd1295e64246f03cf69cdb2af03b60d5fa8d5ae9adc7ecdedde Jul 24 03:24:12.103874 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:12.103843 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:12.205569 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:12.205486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:12.569931 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:12.569855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" event={"ID":"33fb4595-ddcd-419d-9cb3-8a538698f6c0","Type":"ContainerStarted","Data":"905a90ffcef1e458fa32bbdc564f617268f009f68cbac7cde91cb5be35694ec7"} Jul 24 03:24:12.571619 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:12.571587 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" event={"ID":"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2","Type":"ContainerStarted","Data":"7789854b1c88ecd1295e64246f03cf69cdb2af03b60d5fa8d5ae9adc7ecdedde"} Jul 24 03:24:15.588523 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:15.588488 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" event={"ID":"f1e6bbd1-1053-436c-bb1a-72c27c8b2af2","Type":"ContainerStarted","Data":"01f10946d757defce1802b15cef187c52f9d50a0f14b50621b94fd4827c71c38"} Jul 24 03:24:15.589026 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:15.588548 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:15.590105 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:15.590082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" event={"ID":"33fb4595-ddcd-419d-9cb3-8a538698f6c0","Type":"ContainerStarted","Data":"dce3830815413b5ae185f1737aaf065f05f99582816a6cb8002998ca6e1929d9"} Jul 24 03:24:15.607699 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:15.607637 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" podStartSLOduration=1.498492089 podStartE2EDuration="4.607615596s" totalImagesPullingTime="3.109123507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:15.60705108 +0000 UTC m=+359.106554438" watchObservedRunningTime="2026-07-24 03:24:15.607615596 +0000 UTC m=+359.107118939" Jul 24 03:24:16.600671 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:16.600636 2564 generic.go:356] "Generic (PLEG): container finished" podID="33fb4595-ddcd-419d-9cb3-8a538698f6c0" containerID="dce3830815413b5ae185f1737aaf065f05f99582816a6cb8002998ca6e1929d9" exitCode=0 Jul 24 03:24:16.601152 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:16.600726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" event={"ID":"33fb4595-ddcd-419d-9cb3-8a538698f6c0","Type":"ContainerDied","Data":"dce3830815413b5ae185f1737aaf065f05f99582816a6cb8002998ca6e1929d9"} Jul 24 03:24:17.607355 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:17.607320 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" event={"ID":"33fb4595-ddcd-419d-9cb3-8a538698f6c0","Type":"ContainerStarted","Data":"0b9d1a3a6d26787e05a5c335e7b27bfca1eaa7d30650023f8337ba86db70065e"} Jul 24 03:24:17.607760 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:17.607447 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:17.630264 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:17.630217 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" podStartSLOduration=1.58250615 podStartE2EDuration="6.630201171s" totalImagesPullingTime="3.883379365s" totalInitContainerRuntime="1.164315656s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:17.628915428 +0000 UTC m=+361.128418781" watchObservedRunningTime="2026-07-24 03:24:17.630201171 +0000 UTC m=+361.129704511" Jul 24 03:24:25.209625 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:25.209589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:25.307849 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:25.307816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:25.628096 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:25.628049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:25.728915 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:25.728883 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:26.603351 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:26.603320 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-df5f88749-fmlqk" Jul 24 03:24:28.615186 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:28.615135 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-rz2xp" Jul 24 03:24:30.886587 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:30.886551 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:31.028051 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:31.028022 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:31.587510 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:31.587476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:32.024654 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:32.024564 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:32.141236 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:32.141203 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:32.270943 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:32.270908 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:32.383796 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:32.383767 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:32.513746 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:32.513709 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:33.145933 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:33.145899 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:33.476270 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:33.476186 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:33.592737 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:33.592707 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:34.828453 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:34.828415 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:39.685594 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:39.685554 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:39.765641 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:39.765602 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:40.013981 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.013898 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j"] Jul 24 03:24:40.016674 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.016643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.020307 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.020278 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 03:24:40.020601 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.020584 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 03:24:40.020701 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.020652 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 03:24:40.020827 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.020804 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bdv7z\"" Jul 24 03:24:40.045416 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.045381 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j"] Jul 24 03:24:40.070191 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.070156 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:40.094064 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.094064 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsdwl\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-kube-api-access-xsdwl\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.094273 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.094273 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.094273 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.094273 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.094273 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf80a497-ae43-4114-9541-3662d97116d2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.094456 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf80a497-ae43-4114-9541-3662d97116d2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.094456 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.094325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.129092 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.129052 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd"] Jul 24 03:24:40.131477 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.131453 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.149733 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.149698 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd"] Jul 24 03:24:40.194847 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.194816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.194847 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.194853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.194875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.195113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.194898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.195113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.194926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.194972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf80a497-ae43-4114-9541-3662d97116d2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf80a497-ae43-4114-9541-3662d97116d2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8p2t\" (UniqueName: \"kubernetes.io/projected/38f949c8-30af-47c0-9053-342ae8a6d69f-kube-api-access-v8p2t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsdwl\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-kube-api-access-xsdwl\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195350 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f949c8-30af-47c0-9053-342ae8a6d69f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195450 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195450 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.195628 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195555 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.196021 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.195906 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf80a497-ae43-4114-9541-3662d97116d2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.197426 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.197409 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.197547 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.197532 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf80a497-ae43-4114-9541-3662d97116d2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.217158 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.217125 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.217481 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.217458 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsdwl\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-kube-api-access-xsdwl\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcts74j\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.246861 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.246820 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:40.296051 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.295962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296051 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296051 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296051 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8p2t\" (UniqueName: \"kubernetes.io/projected/38f949c8-30af-47c0-9053-342ae8a6d69f-kube-api-access-v8p2t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f949c8-30af-47c0-9053-342ae8a6d69f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296429 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296669 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296596 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296669 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296758 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296907 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.296964 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.296946 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f949c8-30af-47c0-9053-342ae8a6d69f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.298937 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.298912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.299048 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.299031 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.312946 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.312916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f949c8-30af-47c0-9053-342ae8a6d69f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.313588 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.313568 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8p2t\" (UniqueName: \"kubernetes.io/projected/38f949c8-30af-47c0-9053-342ae8a6d69f-kube-api-access-v8p2t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd\" (UID: \"38f949c8-30af-47c0-9053-342ae8a6d69f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.328509 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.328478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:40.344731 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.344702 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:40.441704 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.441673 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:40.502446 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.502082 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j"] Jul 24 03:24:40.507851 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:24:40.507806 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf80a497_ae43_4114_9541_3662d97116d2.slice/crio-f065380784aa0f0a0770782f0e38073ae90772c7ee6fd6464489e3057360cfbe WatchSource:0}: Error finding container f065380784aa0f0a0770782f0e38073ae90772c7ee6fd6464489e3057360cfbe: Status 404 returned error can't find the container with id f065380784aa0f0a0770782f0e38073ae90772c7ee6fd6464489e3057360cfbe Jul 24 03:24:40.594899 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.594874 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd"] Jul 24 03:24:40.597029 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:24:40.597000 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f949c8_30af_47c0_9053_342ae8a6d69f.slice/crio-0b5da27f17d06efdee7476b773d31bca03b0a206d59ac233087d6067e7331825 WatchSource:0}: Error finding container 0b5da27f17d06efdee7476b773d31bca03b0a206d59ac233087d6067e7331825: Status 404 returned error can't find the container with id 0b5da27f17d06efdee7476b773d31bca03b0a206d59ac233087d6067e7331825 Jul 24 03:24:40.713734 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.713697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" event={"ID":"bf80a497-ae43-4114-9541-3662d97116d2","Type":"ContainerStarted","Data":"f065380784aa0f0a0770782f0e38073ae90772c7ee6fd6464489e3057360cfbe"} Jul 24 03:24:40.714838 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.714815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" event={"ID":"38f949c8-30af-47c0-9053-342ae8a6d69f","Type":"ContainerStarted","Data":"0b5da27f17d06efdee7476b773d31bca03b0a206d59ac233087d6067e7331825"} Jul 24 03:24:40.739755 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.739721 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq"] Jul 24 03:24:40.742701 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.742681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.744978 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.744954 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 03:24:40.745083 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.745049 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 03:24:40.745148 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.745087 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 03:24:40.745327 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.745312 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dtcht\"" Jul 24 03:24:40.763396 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.763368 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq"] Jul 24 03:24:40.804953 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.804922 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.805138 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.804965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81ef12de-6f0a-4909-89f8-6dddf145a627-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.805138 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.804993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.805138 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.805071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6tk\" (UniqueName: \"kubernetes.io/projected/81ef12de-6f0a-4909-89f8-6dddf145a627-kube-api-access-6m6tk\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.805138 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.805121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.805371 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.805220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.805371 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.805279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.906258 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.906157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.906258 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.906209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.906258 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.906243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81ef12de-6f0a-4909-89f8-6dddf145a627-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.906568 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.906271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.906568 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.906334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6tk\" (UniqueName: \"kubernetes.io/projected/81ef12de-6f0a-4909-89f8-6dddf145a627-kube-api-access-6m6tk\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.906568 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.906525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.906751 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.906618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.907226 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.907203 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.908629 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.908604 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81ef12de-6f0a-4909-89f8-6dddf145a627-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.908818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.908801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.908923 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.908903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.909094 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.909076 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.914154 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.914129 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81ef12de-6f0a-4909-89f8-6dddf145a627-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:40.914498 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:40.914482 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6tk\" (UniqueName: \"kubernetes.io/projected/81ef12de-6f0a-4909-89f8-6dddf145a627-kube-api-access-6m6tk\") pod \"istiod-openshift-gateway-5677ccb49b-ng5mq\" (UID: \"81ef12de-6f0a-4909-89f8-6dddf145a627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:41.051969 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:41.051940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:41.216826 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:41.216743 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq"] Jul 24 03:24:41.225169 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:24:41.225133 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ef12de_6f0a_4909_89f8_6dddf145a627.slice/crio-3e676736037dd0483564a90453513b4af38a1434c9ff09baae2de5bb138ff34f WatchSource:0}: Error finding container 3e676736037dd0483564a90453513b4af38a1434c9ff09baae2de5bb138ff34f: Status 404 returned error can't find the container with id 3e676736037dd0483564a90453513b4af38a1434c9ff09baae2de5bb138ff34f Jul 24 03:24:41.723725 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:41.723643 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" event={"ID":"81ef12de-6f0a-4909-89f8-6dddf145a627","Type":"ContainerStarted","Data":"3e676736037dd0483564a90453513b4af38a1434c9ff09baae2de5bb138ff34f"} Jul 24 03:24:43.573992 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:43.573914 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:43.689332 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:43.689257 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:43.871703 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:43.871620 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:44.386937 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.386886 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 24 03:24:44.387059 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.386989 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 24 03:24:44.387059 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.386886 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 24 03:24:44.387059 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.387030 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 24 03:24:44.387164 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.387055 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 24 03:24:44.393323 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.393280 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 24 03:24:44.393410 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.393363 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 24 03:24:44.393410 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.393396 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 24 03:24:44.526423 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.526384 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:44.747386 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.747275 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" event={"ID":"bf80a497-ae43-4114-9541-3662d97116d2","Type":"ContainerStarted","Data":"3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258"} Jul 24 03:24:44.749205 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.749167 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" event={"ID":"81ef12de-6f0a-4909-89f8-6dddf145a627","Type":"ContainerStarted","Data":"7cd086b443f55ac4ca96df10e2f4848213e7e400cf5efacbbf94d56009001e45"} Jul 24 03:24:44.749364 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.749233 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:44.751025 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.751002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" event={"ID":"38f949c8-30af-47c0-9053-342ae8a6d69f","Type":"ContainerStarted","Data":"bf5307b92e6efb9fd2412d4c3e5ca3e2847db54666f53270eb4ca25741480930"} Jul 24 03:24:44.767885 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.767820 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" podStartSLOduration=1.884843385 podStartE2EDuration="5.767800238s" totalImagesPullingTime="3.882956853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:44.766979082 +0000 UTC m=+388.266482425" watchObservedRunningTime="2026-07-24 03:24:44.767800238 +0000 UTC m=+388.267303578" Jul 24 03:24:44.794753 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.794688 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" podStartSLOduration=1.007175337 podStartE2EDuration="4.79466567s" totalImagesPullingTime="3.787490333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:44.791593792 +0000 UTC m=+388.291097164" watchObservedRunningTime="2026-07-24 03:24:44.79466567 +0000 UTC m=+388.294169010" Jul 24 03:24:44.821815 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.821749 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" podStartSLOduration=1.66366912 podStartE2EDuration="4.821726007s" totalImagesPullingTime="3.158056887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:44.821277921 +0000 UTC m=+388.320781263" watchObservedRunningTime="2026-07-24 03:24:44.821726007 +0000 UTC m=+388.321229343" Jul 24 03:24:44.870530 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.870494 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:44.996878 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:44.996839 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:45.131122 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.131088 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:24:45.329751 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.329719 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:45.331445 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.331397 2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcts74j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 24 03:24:45.331583 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.331496 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" podUID="bf80a497-ae43-4114-9541-3662d97116d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 24 03:24:45.442957 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.442858 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:45.449135 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.449108 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:45.756219 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.756128 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:45.757018 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.756999 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd" Jul 24 03:24:45.757561 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.757546 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ng5mq" Jul 24 03:24:45.872960 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:45.872922 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j"] Jul 24 03:24:46.329322 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:46.329264 2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcts74j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 24 03:24:46.329531 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:46.329334 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" podUID="bf80a497-ae43-4114-9541-3662d97116d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 24 03:24:47.329149 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:47.329107 2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcts74j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 24 03:24:47.329667 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:47.329175 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" podUID="bf80a497-ae43-4114-9541-3662d97116d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 24 03:24:47.765166 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:47.765039 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" podUID="bf80a497-ae43-4114-9541-3662d97116d2" containerName="istio-proxy" containerID="cri-o://3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258" gracePeriod=30 Jul 24 03:24:53.012162 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.012133 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:53.122571 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122534 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-credential-socket\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.122571 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122573 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-envoy\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.122825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122591 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-istio-token\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.122825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122657 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsdwl\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-kube-api-access-xsdwl\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.122825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122675 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf80a497-ae43-4114-9541-3662d97116d2-istio-podinfo\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.122825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122692 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-certs\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.122825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122722 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-data\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.122825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122761 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf80a497-ae43-4114-9541-3662d97116d2-istiod-ca-cert\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.122825 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122789 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-socket\") pod \"bf80a497-ae43-4114-9541-3662d97116d2\" (UID: \"bf80a497-ae43-4114-9541-3662d97116d2\") " Jul 24 03:24:53.123152 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.122878 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:24:53.123152 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.123059 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:24:53.123152 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.123079 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-credential-socket\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.123152 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.123108 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:24:53.123152 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.123119 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:24:53.123347 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.123210 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf80a497-ae43-4114-9541-3662d97116d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:24:53.125022 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.124991 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:24:53.125151 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.125071 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-kube-api-access-xsdwl" (OuterVolumeSpecName: "kube-api-access-xsdwl") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "kube-api-access-xsdwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:24:53.125151 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.125096 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf80a497-ae43-4114-9541-3662d97116d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 03:24:53.125151 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.125114 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf80a497-ae43-4114-9541-3662d97116d2" (UID: "bf80a497-ae43-4114-9541-3662d97116d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:24:53.223979 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.223939 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsdwl\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-kube-api-access-xsdwl\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.223979 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.223972 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf80a497-ae43-4114-9541-3662d97116d2-istio-podinfo\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.223979 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.223982 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-certs\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.223979 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.223992 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-data\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.224275 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.224001 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf80a497-ae43-4114-9541-3662d97116d2-istiod-ca-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.224275 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.224009 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-workload-socket\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.224275 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.224017 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf80a497-ae43-4114-9541-3662d97116d2-istio-envoy\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.224275 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.224025 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf80a497-ae43-4114-9541-3662d97116d2-istio-token\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:24:53.792640 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.792601 2564 generic.go:356] "Generic (PLEG): container finished" podID="bf80a497-ae43-4114-9541-3662d97116d2" containerID="3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258" exitCode=0 Jul 24 03:24:53.792816 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.792653 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" Jul 24 03:24:53.792816 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.792687 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" event={"ID":"bf80a497-ae43-4114-9541-3662d97116d2","Type":"ContainerDied","Data":"3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258"} Jul 24 03:24:53.792816 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.792741 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j" event={"ID":"bf80a497-ae43-4114-9541-3662d97116d2","Type":"ContainerDied","Data":"f065380784aa0f0a0770782f0e38073ae90772c7ee6fd6464489e3057360cfbe"} Jul 24 03:24:53.792816 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.792763 2564 scope.go:117] "RemoveContainer" containerID="3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258" Jul 24 03:24:53.801568 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.801551 2564 scope.go:117] "RemoveContainer" containerID="3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258" Jul 24 03:24:53.801801 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:24:53.801785 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258\": container with ID starting with 3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258 not found: ID does not exist" containerID="3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258" Jul 24 03:24:53.801850 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.801809 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258"} err="failed to get container status \"3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258\": rpc error: code = NotFound desc = could not find container \"3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258\": container with ID starting with 3ac8d5f89d87a329f9fb8ba3b4aeb66c533f17b6fae132d8f94cee427f28b258 not found: ID does not exist" Jul 24 03:24:53.813841 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.813815 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j"] Jul 24 03:24:53.817486 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:53.817457 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcts74j"] Jul 24 03:24:55.050676 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:24:55.050643 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf80a497-ae43-4114-9541-3662d97116d2" path="/var/lib/kubelet/pods/bf80a497-ae43-4114-9541-3662d97116d2/volumes" Jul 24 03:25:08.683823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:08.683756 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:08.785405 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:08.785371 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:15.140046 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:15.140009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:15.240657 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:15.240605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:31.134011 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:31.133977 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:31.249546 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:31.249509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:32.372485 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:32.372446 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:32.557317 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:32.557272 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:32.764459 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:32.764348 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:33.129453 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:33.129422 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:33.239311 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:33.239258 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:47.010080 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.009997 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs"] Jul 24 03:25:47.010582 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.010374 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf80a497-ae43-4114-9541-3662d97116d2" containerName="istio-proxy" Jul 24 03:25:47.010582 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.010386 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf80a497-ae43-4114-9541-3662d97116d2" containerName="istio-proxy" Jul 24 03:25:47.010582 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.010440 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf80a497-ae43-4114-9541-3662d97116d2" containerName="istio-proxy" Jul 24 03:25:47.013370 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.013352 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.016197 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.016143 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9t75r\"" Jul 24 03:25:47.016557 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.016539 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 03:25:47.016657 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.016559 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 03:25:47.022224 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.022167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs"] Jul 24 03:25:47.089249 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.089206 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:47.093819 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.093792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.093952 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.093826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.093952 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.093850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9vcc\" (UniqueName: \"kubernetes.io/projected/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-kube-api-access-z9vcc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.161907 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.161873 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:47.195062 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.195027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.195283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.195074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.195283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.195095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9vcc\" (UniqueName: \"kubernetes.io/projected/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-kube-api-access-z9vcc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.195517 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.195496 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.195565 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.195539 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.203361 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.203339 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9vcc\" (UniqueName: \"kubernetes.io/projected/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-kube-api-access-z9vcc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.323132 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.323105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:47.413862 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.413453 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds"] Jul 24 03:25:47.416249 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.416227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.425559 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.425531 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds"] Jul 24 03:25:47.458387 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.458364 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs"] Jul 24 03:25:47.460414 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:25:47.460383 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f61a086_7f9c_4a80_8e52_d37c820c7d9f.slice/crio-59a107db78edb294de305dca9fe02c03a9be9b373e07df95df73fbef2c61d877 WatchSource:0}: Error finding container 59a107db78edb294de305dca9fe02c03a9be9b373e07df95df73fbef2c61d877: Status 404 returned error can't find the container with id 59a107db78edb294de305dca9fe02c03a9be9b373e07df95df73fbef2c61d877 Jul 24 03:25:47.498408 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.498380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.498527 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.498425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zb9s\" (UniqueName: \"kubernetes.io/projected/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-kube-api-access-5zb9s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.498527 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.498494 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.599593 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.599506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.599593 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.599545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zb9s\" (UniqueName: \"kubernetes.io/projected/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-kube-api-access-5zb9s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.599593 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.599570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.599912 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.599894 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.599949 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.599919 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.627187 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.627152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zb9s\" (UniqueName: \"kubernetes.io/projected/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-kube-api-access-5zb9s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.729118 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.729078 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:47.841769 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.841734 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j"] Jul 24 03:25:47.845644 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.845618 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:47.860852 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.860823 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j"] Jul 24 03:25:47.868239 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:47.868205 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds"] Jul 24 03:25:47.870666 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:25:47.870637 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efcc6cf_c573_4c6f_9e73_b926e2746c2e.slice/crio-bf3719cc1d1c0cacf16a12251a32a2e3a4799797901b5432fe1cc21a0ece7b4f WatchSource:0}: Error finding container bf3719cc1d1c0cacf16a12251a32a2e3a4799797901b5432fe1cc21a0ece7b4f: Status 404 returned error can't find the container with id bf3719cc1d1c0cacf16a12251a32a2e3a4799797901b5432fe1cc21a0ece7b4f Jul 24 03:25:48.003313 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.003270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s855\" (UniqueName: \"kubernetes.io/projected/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-kube-api-access-8s855\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.003504 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.003384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.003504 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.003435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.038737 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.038702 2564 generic.go:356] "Generic (PLEG): container finished" podID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerID="fca2a03cda8a34b04ffb20b1676aca8ca436dbb61dfb411f228508a3baef210d" exitCode=0 Jul 24 03:25:48.039189 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.038784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" event={"ID":"0efcc6cf-c573-4c6f-9e73-b926e2746c2e","Type":"ContainerDied","Data":"fca2a03cda8a34b04ffb20b1676aca8ca436dbb61dfb411f228508a3baef210d"} Jul 24 03:25:48.039189 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.038831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" event={"ID":"0efcc6cf-c573-4c6f-9e73-b926e2746c2e","Type":"ContainerStarted","Data":"bf3719cc1d1c0cacf16a12251a32a2e3a4799797901b5432fe1cc21a0ece7b4f"} Jul 24 03:25:48.040490 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.040467 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerID="7c9a9018fe9497d3306fc748aa38fe611e0d1650199ff2f2faae22eb1115145e" exitCode=0 Jul 24 03:25:48.040593 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.040538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" event={"ID":"6f61a086-7f9c-4a80-8e52-d37c820c7d9f","Type":"ContainerDied","Data":"7c9a9018fe9497d3306fc748aa38fe611e0d1650199ff2f2faae22eb1115145e"} Jul 24 03:25:48.040593 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.040571 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" event={"ID":"6f61a086-7f9c-4a80-8e52-d37c820c7d9f","Type":"ContainerStarted","Data":"59a107db78edb294de305dca9fe02c03a9be9b373e07df95df73fbef2c61d877"} Jul 24 03:25:48.103956 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.103867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.103956 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.103898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.103956 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.103955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s855\" (UniqueName: \"kubernetes.io/projected/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-kube-api-access-8s855\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.104364 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.104341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.104413 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.104341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.112417 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.112394 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s855\" (UniqueName: \"kubernetes.io/projected/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-kube-api-access-8s855\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.156011 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.155963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:48.215541 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.215512 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5"] Jul 24 03:25:48.218544 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.218519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.227411 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.227381 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5"] Jul 24 03:25:48.295215 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.295187 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j"] Jul 24 03:25:48.297040 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:25:48.297010 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f9da71_89c2_4e3e_b0d4_9016eee4dfb1.slice/crio-65115c8e210289d1ad2a2f35261ae8060beea4ddfce4ca458fc128f2c849acca WatchSource:0}: Error finding container 65115c8e210289d1ad2a2f35261ae8060beea4ddfce4ca458fc128f2c849acca: Status 404 returned error can't find the container with id 65115c8e210289d1ad2a2f35261ae8060beea4ddfce4ca458fc128f2c849acca Jul 24 03:25:48.306789 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.306765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhsx2\" (UniqueName: \"kubernetes.io/projected/493315ab-d8fc-410a-8b44-5efc930db9c3-kube-api-access-qhsx2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.306872 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.306800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.306955 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.306930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.408366 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.408339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.408481 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.408422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.408481 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.408464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhsx2\" (UniqueName: \"kubernetes.io/projected/493315ab-d8fc-410a-8b44-5efc930db9c3-kube-api-access-qhsx2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.408781 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.408763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.408828 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.408775 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.418582 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.418563 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhsx2\" (UniqueName: \"kubernetes.io/projected/493315ab-d8fc-410a-8b44-5efc930db9c3-kube-api-access-qhsx2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.529869 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.529835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:48.671583 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:48.671510 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5"] Jul 24 03:25:48.683379 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:25:48.683347 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493315ab_d8fc_410a_8b44_5efc930db9c3.slice/crio-81292c1cb51dbff87db928ec10c1141cba513bb4e41459ef24aeb35fbc3a7d23 WatchSource:0}: Error finding container 81292c1cb51dbff87db928ec10c1141cba513bb4e41459ef24aeb35fbc3a7d23: Status 404 returned error can't find the container with id 81292c1cb51dbff87db928ec10c1141cba513bb4e41459ef24aeb35fbc3a7d23 Jul 24 03:25:49.046750 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.046720 2564 generic.go:356] "Generic (PLEG): container finished" podID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerID="1a14935a02fe8d8d8d87fae72b16d6d6f88e7e0b86738e7722510ccb4facfc65" exitCode=0 Jul 24 03:25:49.048763 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.048736 2564 generic.go:356] "Generic (PLEG): container finished" podID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerID="10f8723c33fb4b041b8ba10362c6217ea4511896fa04fd5d0ef6f23518246150" exitCode=0 Jul 24 03:25:49.050793 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.050769 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerID="782ab664b0b3173e1506ea18296feaf07b3bc39d30b966efec4b7afbd5b9c1f5" exitCode=0 Jul 24 03:25:49.051880 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.051843 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" event={"ID":"493315ab-d8fc-410a-8b44-5efc930db9c3","Type":"ContainerDied","Data":"1a14935a02fe8d8d8d87fae72b16d6d6f88e7e0b86738e7722510ccb4facfc65"} Jul 24 03:25:49.051985 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.051906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" event={"ID":"493315ab-d8fc-410a-8b44-5efc930db9c3","Type":"ContainerStarted","Data":"81292c1cb51dbff87db928ec10c1141cba513bb4e41459ef24aeb35fbc3a7d23"} Jul 24 03:25:49.051985 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.051929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" event={"ID":"0efcc6cf-c573-4c6f-9e73-b926e2746c2e","Type":"ContainerDied","Data":"10f8723c33fb4b041b8ba10362c6217ea4511896fa04fd5d0ef6f23518246150"} Jul 24 03:25:49.051985 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.051952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" event={"ID":"6f61a086-7f9c-4a80-8e52-d37c820c7d9f","Type":"ContainerDied","Data":"782ab664b0b3173e1506ea18296feaf07b3bc39d30b966efec4b7afbd5b9c1f5"} Jul 24 03:25:49.052417 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.052399 2564 generic.go:356] "Generic (PLEG): container finished" podID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerID="8d765999ec1cf38df10bb98821a62e1662b8b9ed772ded020047ff13f8e1818e" exitCode=0 Jul 24 03:25:49.052474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.052426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" event={"ID":"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1","Type":"ContainerDied","Data":"8d765999ec1cf38df10bb98821a62e1662b8b9ed772ded020047ff13f8e1818e"} Jul 24 03:25:49.052474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:49.052450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" event={"ID":"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1","Type":"ContainerStarted","Data":"65115c8e210289d1ad2a2f35261ae8060beea4ddfce4ca458fc128f2c849acca"} Jul 24 03:25:50.059396 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:50.059363 2564 generic.go:356] "Generic (PLEG): container finished" podID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerID="4405403a199ad9e43448d2fe04a4c834546dd39eab4c7bc0f0f53d0256d4236a" exitCode=0 Jul 24 03:25:50.059778 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:50.059446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" event={"ID":"0efcc6cf-c573-4c6f-9e73-b926e2746c2e","Type":"ContainerDied","Data":"4405403a199ad9e43448d2fe04a4c834546dd39eab4c7bc0f0f53d0256d4236a"} Jul 24 03:25:50.061452 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:50.061431 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerID="dce8cad7921c9283a3d1f24406e8df1f9f424bacbb677a8079a87f953a882fdb" exitCode=0 Jul 24 03:25:50.061558 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:50.061500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" event={"ID":"6f61a086-7f9c-4a80-8e52-d37c820c7d9f","Type":"ContainerDied","Data":"dce8cad7921c9283a3d1f24406e8df1f9f424bacbb677a8079a87f953a882fdb"} Jul 24 03:25:50.063113 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:50.063093 2564 generic.go:356] "Generic (PLEG): container finished" podID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerID="ee32c9986336b81b8c9a3515a2321bd81fa9a30867d7758756060effac398540" exitCode=0 Jul 24 03:25:50.063200 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:50.063168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" event={"ID":"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1","Type":"ContainerDied","Data":"ee32c9986336b81b8c9a3515a2321bd81fa9a30867d7758756060effac398540"} Jul 24 03:25:50.065109 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:50.065091 2564 generic.go:356] "Generic (PLEG): container finished" podID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerID="1a070b276c3f58d2a9fdbc42b5b2de9a55adc9d53eca2d2ab13db1c5b05ce581" exitCode=0 Jul 24 03:25:50.065173 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:50.065162 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" event={"ID":"493315ab-d8fc-410a-8b44-5efc930db9c3","Type":"ContainerDied","Data":"1a070b276c3f58d2a9fdbc42b5b2de9a55adc9d53eca2d2ab13db1c5b05ce581"} Jul 24 03:25:51.072463 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.072428 2564 generic.go:356] "Generic (PLEG): container finished" podID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerID="7eebddf256d54bd90b9b37a6af0ea758466679c2f53a27dbbe831c30c6768613" exitCode=0 Jul 24 03:25:51.072928 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.072519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" event={"ID":"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1","Type":"ContainerDied","Data":"7eebddf256d54bd90b9b37a6af0ea758466679c2f53a27dbbe831c30c6768613"} Jul 24 03:25:51.074631 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.074607 2564 generic.go:356] "Generic (PLEG): container finished" podID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerID="696a09c5ab091f868694f7e58470aa793268f8526ab45e47d735276d45046e2b" exitCode=0 Jul 24 03:25:51.074773 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.074678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" event={"ID":"493315ab-d8fc-410a-8b44-5efc930db9c3","Type":"ContainerDied","Data":"696a09c5ab091f868694f7e58470aa793268f8526ab45e47d735276d45046e2b"} Jul 24 03:25:51.250196 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.250169 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:51.253158 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.253133 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:51.437630 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.437537 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-util\") pod \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " Jul 24 03:25:51.437630 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.437577 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zb9s\" (UniqueName: \"kubernetes.io/projected/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-kube-api-access-5zb9s\") pod \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " Jul 24 03:25:51.437630 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.437617 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-bundle\") pod \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " Jul 24 03:25:51.437905 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.437676 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9vcc\" (UniqueName: \"kubernetes.io/projected/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-kube-api-access-z9vcc\") pod \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " Jul 24 03:25:51.437905 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.437701 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-util\") pod \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\" (UID: \"0efcc6cf-c573-4c6f-9e73-b926e2746c2e\") " Jul 24 03:25:51.437905 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.437742 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-bundle\") pod \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\" (UID: \"6f61a086-7f9c-4a80-8e52-d37c820c7d9f\") " Jul 24 03:25:51.438347 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.438318 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-bundle" (OuterVolumeSpecName: "bundle") pod "0efcc6cf-c573-4c6f-9e73-b926e2746c2e" (UID: "0efcc6cf-c573-4c6f-9e73-b926e2746c2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:25:51.438436 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.438353 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-bundle" (OuterVolumeSpecName: "bundle") pod "6f61a086-7f9c-4a80-8e52-d37c820c7d9f" (UID: "6f61a086-7f9c-4a80-8e52-d37c820c7d9f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:25:51.440471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.440438 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-kube-api-access-z9vcc" (OuterVolumeSpecName: "kube-api-access-z9vcc") pod "6f61a086-7f9c-4a80-8e52-d37c820c7d9f" (UID: "6f61a086-7f9c-4a80-8e52-d37c820c7d9f"). InnerVolumeSpecName "kube-api-access-z9vcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:25:51.440471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.440453 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-kube-api-access-5zb9s" (OuterVolumeSpecName: "kube-api-access-5zb9s") pod "0efcc6cf-c573-4c6f-9e73-b926e2746c2e" (UID: "0efcc6cf-c573-4c6f-9e73-b926e2746c2e"). InnerVolumeSpecName "kube-api-access-5zb9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:25:51.443285 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.443240 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-util" (OuterVolumeSpecName: "util") pod "6f61a086-7f9c-4a80-8e52-d37c820c7d9f" (UID: "6f61a086-7f9c-4a80-8e52-d37c820c7d9f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:25:51.446163 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.446130 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-util" (OuterVolumeSpecName: "util") pod "0efcc6cf-c573-4c6f-9e73-b926e2746c2e" (UID: "0efcc6cf-c573-4c6f-9e73-b926e2746c2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:25:51.539079 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.539046 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9vcc\" (UniqueName: \"kubernetes.io/projected/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-kube-api-access-z9vcc\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:51.539079 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.539076 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-util\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:51.539079 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.539086 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:51.539326 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.539093 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f61a086-7f9c-4a80-8e52-d37c820c7d9f-util\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:51.539326 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.539101 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zb9s\" (UniqueName: \"kubernetes.io/projected/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-kube-api-access-5zb9s\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:51.539326 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:51.539109 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efcc6cf-c573-4c6f-9e73-b926e2746c2e-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:52.081226 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.081200 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" Jul 24 03:25:52.081226 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.081220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds" event={"ID":"0efcc6cf-c573-4c6f-9e73-b926e2746c2e","Type":"ContainerDied","Data":"bf3719cc1d1c0cacf16a12251a32a2e3a4799797901b5432fe1cc21a0ece7b4f"} Jul 24 03:25:52.081703 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.081263 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf3719cc1d1c0cacf16a12251a32a2e3a4799797901b5432fe1cc21a0ece7b4f" Jul 24 03:25:52.083277 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.083258 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" Jul 24 03:25:52.083397 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.083289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs" event={"ID":"6f61a086-7f9c-4a80-8e52-d37c820c7d9f","Type":"ContainerDied","Data":"59a107db78edb294de305dca9fe02c03a9be9b373e07df95df73fbef2c61d877"} Jul 24 03:25:52.083397 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.083357 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59a107db78edb294de305dca9fe02c03a9be9b373e07df95df73fbef2c61d877" Jul 24 03:25:52.220148 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.220119 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:52.254190 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.254160 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:52.347035 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.346925 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-bundle\") pod \"493315ab-d8fc-410a-8b44-5efc930db9c3\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " Jul 24 03:25:52.347035 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.346997 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhsx2\" (UniqueName: \"kubernetes.io/projected/493315ab-d8fc-410a-8b44-5efc930db9c3-kube-api-access-qhsx2\") pod \"493315ab-d8fc-410a-8b44-5efc930db9c3\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " Jul 24 03:25:52.347254 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.347047 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-util\") pod \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " Jul 24 03:25:52.347254 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.347075 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s855\" (UniqueName: \"kubernetes.io/projected/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-kube-api-access-8s855\") pod \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " Jul 24 03:25:52.347254 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.347162 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-util\") pod \"493315ab-d8fc-410a-8b44-5efc930db9c3\" (UID: \"493315ab-d8fc-410a-8b44-5efc930db9c3\") " Jul 24 03:25:52.347452 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.347285 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-bundle\") pod \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\" (UID: \"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1\") " Jul 24 03:25:52.347698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.347672 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-bundle" (OuterVolumeSpecName: "bundle") pod "493315ab-d8fc-410a-8b44-5efc930db9c3" (UID: "493315ab-d8fc-410a-8b44-5efc930db9c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:25:52.348171 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.348147 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-bundle" (OuterVolumeSpecName: "bundle") pod "98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" (UID: "98f9da71-89c2-4e3e-b0d4-9016eee4dfb1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:25:52.349373 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.349340 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-kube-api-access-8s855" (OuterVolumeSpecName: "kube-api-access-8s855") pod "98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" (UID: "98f9da71-89c2-4e3e-b0d4-9016eee4dfb1"). InnerVolumeSpecName "kube-api-access-8s855". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:25:52.349481 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.349390 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493315ab-d8fc-410a-8b44-5efc930db9c3-kube-api-access-qhsx2" (OuterVolumeSpecName: "kube-api-access-qhsx2") pod "493315ab-d8fc-410a-8b44-5efc930db9c3" (UID: "493315ab-d8fc-410a-8b44-5efc930db9c3"). InnerVolumeSpecName "kube-api-access-qhsx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:25:52.353132 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.353099 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-util" (OuterVolumeSpecName: "util") pod "98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" (UID: "98f9da71-89c2-4e3e-b0d4-9016eee4dfb1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:25:52.353197 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.353178 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-util" (OuterVolumeSpecName: "util") pod "493315ab-d8fc-410a-8b44-5efc930db9c3" (UID: "493315ab-d8fc-410a-8b44-5efc930db9c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:25:52.448729 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.448704 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:52.448729 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.448730 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhsx2\" (UniqueName: \"kubernetes.io/projected/493315ab-d8fc-410a-8b44-5efc930db9c3-kube-api-access-qhsx2\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:52.448869 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.448740 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-util\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:52.448869 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.448750 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s855\" (UniqueName: \"kubernetes.io/projected/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-kube-api-access-8s855\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:52.448869 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.448758 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493315ab-d8fc-410a-8b44-5efc930db9c3-util\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:52.448869 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:52.448765 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98f9da71-89c2-4e3e-b0d4-9016eee4dfb1-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:25:53.090345 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:53.090314 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" Jul 24 03:25:53.090345 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:53.090316 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j" event={"ID":"98f9da71-89c2-4e3e-b0d4-9016eee4dfb1","Type":"ContainerDied","Data":"65115c8e210289d1ad2a2f35261ae8060beea4ddfce4ca458fc128f2c849acca"} Jul 24 03:25:53.090889 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:53.090369 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65115c8e210289d1ad2a2f35261ae8060beea4ddfce4ca458fc128f2c849acca" Jul 24 03:25:53.092284 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:53.092256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" event={"ID":"493315ab-d8fc-410a-8b44-5efc930db9c3","Type":"ContainerDied","Data":"81292c1cb51dbff87db928ec10c1141cba513bb4e41459ef24aeb35fbc3a7d23"} Jul 24 03:25:53.092417 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:53.092317 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5" Jul 24 03:25:53.092478 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:53.092325 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81292c1cb51dbff87db928ec10c1141cba513bb4e41459ef24aeb35fbc3a7d23" Jul 24 03:25:54.690634 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:54.690599 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:55.355256 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:55.355220 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:55.742319 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:55.742212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:57.169555 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:57.169517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:57.272512 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:57.272483 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:25:59.732465 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:25:59.732427 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:02.563449 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:02.563408 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:02.692494 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:02.692449 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:04.823471 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:04.823440 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:05.458767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:05.458735 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:07.209195 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:07.209126 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:07.859034 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:07.859000 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c58ff4df4-2s756"] Jul 24 03:26:08.053087 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:08.053056 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:08.207861 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:08.207783 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:08.349545 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:08.349504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:10.069576 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:10.069523 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:10.183739 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:10.183690 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:13.818577 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:13.818543 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:13.941949 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:13.941905 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:17.622985 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:17.622949 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:17.795265 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:17.795227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:18.031255 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:18.031155 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:18.237039 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:18.237003 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:21.373478 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:21.373434 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:21.470943 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:21.470911 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:23.517125 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:23.517093 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:23.592088 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:23.592049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:28.391717 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:28.391682 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:28.523059 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:28.523028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:29.474271 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:29.474234 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:29.616352 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:29.616288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:32.278749 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:32.278702 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:32.511711 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:32.511659 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:32.878244 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:32.878188 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c58ff4df4-2s756" podUID="eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" containerName="console" containerID="cri-o://b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61" gracePeriod=15 Jul 24 03:26:33.031015 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.030976 2564 patch_prober.go:28] interesting pod/console-6c58ff4df4-2s756 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jul 24 03:26:33.031181 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.031048 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6c58ff4df4-2s756" podUID="eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jul 24 03:26:33.130940 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.130885 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:26:33.293204 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.293170 2564 generic.go:356] "Generic (PLEG): container finished" podID="eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" containerID="b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61" exitCode=0 Jul 24 03:26:33.293670 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.293214 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c58ff4df4-2s756" Jul 24 03:26:33.293670 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.293253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c58ff4df4-2s756" event={"ID":"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4","Type":"ContainerDied","Data":"b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61"} Jul 24 03:26:33.293670 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.293322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c58ff4df4-2s756" event={"ID":"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4","Type":"ContainerDied","Data":"644da933c1052a744165b9cfa2f0780460a4c75e4abfd16f778d03fe9dac3fd3"} Jul 24 03:26:33.293670 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.293350 2564 scope.go:117] "RemoveContainer" containerID="b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61" Jul 24 03:26:33.296581 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.296564 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-trusted-ca-bundle\") pod \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " Jul 24 03:26:33.296662 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.296591 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-config\") pod \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " Jul 24 03:26:33.296662 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.296617 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4qnt\" (UniqueName: \"kubernetes.io/projected/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-kube-api-access-v4qnt\") pod \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " Jul 24 03:26:33.296734 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.296687 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-service-ca\") pod \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " Jul 24 03:26:33.296734 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.296717 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-serving-cert\") pod \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " Jul 24 03:26:33.296833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.296753 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-oauth-config\") pod \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " Jul 24 03:26:33.296833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.296804 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-oauth-serving-cert\") pod \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\" (UID: \"eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4\") " Jul 24 03:26:33.297149 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.297124 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-config" (OuterVolumeSpecName: "console-config") pod "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" (UID: "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:26:33.297286 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.297006 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" (UID: "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:26:33.297405 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.297243 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" (UID: "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:26:33.297477 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.297357 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-config\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:26:33.297477 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.297416 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" (UID: "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:26:33.299030 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.299008 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-kube-api-access-v4qnt" (OuterVolumeSpecName: "kube-api-access-v4qnt") pod "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" (UID: "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4"). InnerVolumeSpecName "kube-api-access-v4qnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:26:33.299456 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.299416 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" (UID: "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:26:33.299533 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.299482 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" (UID: "eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:26:33.302443 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.302430 2564 scope.go:117] "RemoveContainer" containerID="b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61" Jul 24 03:26:33.302769 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:26:33.302751 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61\": container with ID starting with b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61 not found: ID does not exist" containerID="b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61" Jul 24 03:26:33.302832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.302779 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61"} err="failed to get container status \"b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61\": rpc error: code = NotFound desc = could not find container \"b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61\": container with ID starting with b93b700d1502e54e4186a559a7590673cadc44390b55c2c22e8a80ef96f16e61 not found: ID does not exist" Jul 24 03:26:33.398767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.398673 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-trusted-ca-bundle\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:26:33.398767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.398707 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4qnt\" (UniqueName: \"kubernetes.io/projected/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-kube-api-access-v4qnt\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:26:33.398767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.398720 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-service-ca\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:26:33.398767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.398732 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-serving-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:26:33.398767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.398744 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-console-oauth-config\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:26:33.398767 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.398756 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4-oauth-serving-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:26:33.626668 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.626619 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c58ff4df4-2s756"] Jul 24 03:26:33.635720 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:33.635692 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c58ff4df4-2s756"] Jul 24 03:26:35.049683 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:35.049641 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" path="/var/lib/kubelet/pods/eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4/volumes" Jul 24 03:26:37.360684 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:37.360643 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:37.463798 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:37.463764 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:40.859935 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:40.859903 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:26:40.980938 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:26:40.980908 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:12.338480 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:12.338388 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:12.452416 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:12.452375 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:12.871105 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:12.871070 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:12.971888 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:12.971858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:17.479902 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:17.479853 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:17.604453 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:17.604406 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:17.660523 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:17.660494 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:18.300484 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:18.300450 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:18.375505 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:18.375476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:22.991223 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:22.991188 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:29.768871 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:29.768837 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:29.821606 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:29.821574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:38.720667 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:38.720631 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:38.818996 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:38.818951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:39.177162 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:39.177124 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:50.992941 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:50.992909 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:51.103532 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:51.103504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:57.884276 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.884245 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:57.896056 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896022 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fdbdf5bdd-2f8rw"] Jul 24 03:27:57.896353 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896340 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerName="extract" Jul 24 03:27:57.896400 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896355 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerName="extract" Jul 24 03:27:57.896400 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896365 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerName="pull" Jul 24 03:27:57.896400 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896372 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerName="pull" Jul 24 03:27:57.896400 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896382 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerName="pull" Jul 24 03:27:57.896400 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896386 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerName="pull" Jul 24 03:27:57.896400 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896394 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerName="util" Jul 24 03:27:57.896400 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896399 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerName="util" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896404 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerName="pull" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896409 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerName="pull" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896415 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerName="util" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896420 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerName="util" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896425 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896429 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896435 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896441 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896448 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" containerName="console" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896452 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" containerName="console" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896459 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerName="util" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896464 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerName="util" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896470 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896475 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896482 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerName="pull" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896487 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerName="pull" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896496 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerName="util" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896500 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerName="util" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896555 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="98f9da71-89c2-4e3e-b0d4-9016eee4dfb1" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896562 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0efcc6cf-c573-4c6f-9e73-b926e2746c2e" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896567 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="493315ab-d8fc-410a-8b44-5efc930db9c3" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896573 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f61a086-7f9c-4a80-8e52-d37c820c7d9f" containerName="extract" Jul 24 03:27:57.896682 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.896580 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb0fe1e5-bb72-4ee9-abdf-08d22b439ce4" containerName="console" Jul 24 03:27:57.899727 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.899708 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:27:57.902058 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.902035 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 24 03:27:57.902161 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.902035 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 24 03:27:57.902161 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.902136 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ngcwl\"" Jul 24 03:27:57.910234 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.910204 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdbdf5bdd-2f8rw"] Jul 24 03:27:57.984818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:57.984780 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:58.027095 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.027060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fb3bb95-2a6a-4c76-9ef8-783d60925612-webhook-cert\") pod \"maas-controller-5fdbdf5bdd-2f8rw\" (UID: \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\") " pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:27:58.027254 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.027122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj9mm\" (UniqueName: \"kubernetes.io/projected/6fb3bb95-2a6a-4c76-9ef8-783d60925612-kube-api-access-cj9mm\") pod \"maas-controller-5fdbdf5bdd-2f8rw\" (UID: \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\") " pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:27:58.079803 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.079758 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:58.083900 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.083872 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8485f56769-2sk7k"] Jul 24 03:27:58.087186 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.087165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:27:58.098151 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.098127 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8485f56769-2sk7k"] Jul 24 03:27:58.127692 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.127659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngmnq\" (UniqueName: \"kubernetes.io/projected/dbdb1e45-8a42-4596-8afb-2c616847a7a2-kube-api-access-ngmnq\") pod \"maas-controller-8485f56769-2sk7k\" (UID: \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\") " pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:27:58.127863 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.127764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fb3bb95-2a6a-4c76-9ef8-783d60925612-webhook-cert\") pod \"maas-controller-5fdbdf5bdd-2f8rw\" (UID: \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\") " pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:27:58.127863 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.127794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbdb1e45-8a42-4596-8afb-2c616847a7a2-webhook-cert\") pod \"maas-controller-8485f56769-2sk7k\" (UID: \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\") " pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:27:58.127863 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.127859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj9mm\" (UniqueName: \"kubernetes.io/projected/6fb3bb95-2a6a-4c76-9ef8-783d60925612-kube-api-access-cj9mm\") pod \"maas-controller-5fdbdf5bdd-2f8rw\" (UID: \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\") " pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:27:58.130157 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.130135 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fb3bb95-2a6a-4c76-9ef8-783d60925612-webhook-cert\") pod \"maas-controller-5fdbdf5bdd-2f8rw\" (UID: \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\") " pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:27:58.135337 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.135258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj9mm\" (UniqueName: \"kubernetes.io/projected/6fb3bb95-2a6a-4c76-9ef8-783d60925612-kube-api-access-cj9mm\") pod \"maas-controller-5fdbdf5bdd-2f8rw\" (UID: \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\") " pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:27:58.144424 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.144397 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:27:58.211537 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.211502 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:27:58.228845 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.228812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngmnq\" (UniqueName: \"kubernetes.io/projected/dbdb1e45-8a42-4596-8afb-2c616847a7a2-kube-api-access-ngmnq\") pod \"maas-controller-8485f56769-2sk7k\" (UID: \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\") " pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:27:58.228987 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.228920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbdb1e45-8a42-4596-8afb-2c616847a7a2-webhook-cert\") pod \"maas-controller-8485f56769-2sk7k\" (UID: \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\") " pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:27:58.231408 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.231383 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbdb1e45-8a42-4596-8afb-2c616847a7a2-webhook-cert\") pod \"maas-controller-8485f56769-2sk7k\" (UID: \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\") " pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:27:58.238356 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.238329 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngmnq\" (UniqueName: \"kubernetes.io/projected/dbdb1e45-8a42-4596-8afb-2c616847a7a2-kube-api-access-ngmnq\") pod \"maas-controller-8485f56769-2sk7k\" (UID: \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\") " pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:27:58.355066 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.355037 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdbdf5bdd-2f8rw"] Jul 24 03:27:58.397564 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.397487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:27:58.530364 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.530314 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8485f56769-2sk7k"] Jul 24 03:27:58.533040 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:27:58.533009 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdb1e45_8a42_4596_8afb_2c616847a7a2.slice/crio-218346496f84acf2f575f9d55e732683ef58a6ce12894606efa27e24d9726e29 WatchSource:0}: Error finding container 218346496f84acf2f575f9d55e732683ef58a6ce12894606efa27e24d9726e29: Status 404 returned error can't find the container with id 218346496f84acf2f575f9d55e732683ef58a6ce12894606efa27e24d9726e29 Jul 24 03:27:58.708202 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.708103 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" event={"ID":"6fb3bb95-2a6a-4c76-9ef8-783d60925612","Type":"ContainerStarted","Data":"8feba277db73922a93412316b06192a879dbfc55ffa0f0f1323f732ca85524e9"} Jul 24 03:27:58.709202 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:27:58.709172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-2sk7k" event={"ID":"dbdb1e45-8a42-4596-8afb-2c616847a7a2","Type":"ContainerStarted","Data":"218346496f84acf2f575f9d55e732683ef58a6ce12894606efa27e24d9726e29"} Jul 24 03:28:01.143799 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:01.143748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:28:01.239902 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:01.239809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:28:01.726355 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:01.726320 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" event={"ID":"6fb3bb95-2a6a-4c76-9ef8-783d60925612","Type":"ContainerStarted","Data":"50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b"} Jul 24 03:28:01.726557 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:01.726406 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:28:01.727815 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:01.727795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-2sk7k" event={"ID":"dbdb1e45-8a42-4596-8afb-2c616847a7a2","Type":"ContainerStarted","Data":"32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa"} Jul 24 03:28:01.727903 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:01.727877 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:28:01.752019 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:01.751965 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" podStartSLOduration=2.136356094 podStartE2EDuration="4.751946153s" totalImagesPullingTime="2.615590059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:28:01.750038591 +0000 UTC m=+585.249541933" watchObservedRunningTime="2026-07-24 03:28:01.751946153 +0000 UTC m=+585.251449493" Jul 24 03:28:01.771575 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:01.771519 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8485f56769-2sk7k" podStartSLOduration=1.325539137 podStartE2EDuration="3.77150231s" totalImagesPullingTime="2.445963173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:28:01.770756869 +0000 UTC m=+585.270260212" watchObservedRunningTime="2026-07-24 03:28:01.77150231 +0000 UTC m=+585.271005707" Jul 24 03:28:12.734965 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:12.734929 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:28:12.735396 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:12.735007 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:28:12.805844 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:12.805809 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fdbdf5bdd-2f8rw"] Jul 24 03:28:12.806043 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:12.806000 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" podUID="6fb3bb95-2a6a-4c76-9ef8-783d60925612" containerName="manager" containerID="cri-o://50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b" gracePeriod=30 Jul 24 03:28:13.053994 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.053969 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:28:13.170100 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.170062 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj9mm\" (UniqueName: \"kubernetes.io/projected/6fb3bb95-2a6a-4c76-9ef8-783d60925612-kube-api-access-cj9mm\") pod \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\" (UID: \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\") " Jul 24 03:28:13.170276 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.170144 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fb3bb95-2a6a-4c76-9ef8-783d60925612-webhook-cert\") pod \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\" (UID: \"6fb3bb95-2a6a-4c76-9ef8-783d60925612\") " Jul 24 03:28:13.172341 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.172307 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fb3bb95-2a6a-4c76-9ef8-783d60925612-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6fb3bb95-2a6a-4c76-9ef8-783d60925612" (UID: "6fb3bb95-2a6a-4c76-9ef8-783d60925612"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:28:13.172482 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.172352 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb3bb95-2a6a-4c76-9ef8-783d60925612-kube-api-access-cj9mm" (OuterVolumeSpecName: "kube-api-access-cj9mm") pod "6fb3bb95-2a6a-4c76-9ef8-783d60925612" (UID: "6fb3bb95-2a6a-4c76-9ef8-783d60925612"). InnerVolumeSpecName "kube-api-access-cj9mm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:28:13.271029 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.270987 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj9mm\" (UniqueName: \"kubernetes.io/projected/6fb3bb95-2a6a-4c76-9ef8-783d60925612-kube-api-access-cj9mm\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:28:13.271029 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.271018 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fb3bb95-2a6a-4c76-9ef8-783d60925612-webhook-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:28:13.792580 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.792548 2564 generic.go:356] "Generic (PLEG): container finished" podID="6fb3bb95-2a6a-4c76-9ef8-783d60925612" containerID="50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b" exitCode=0 Jul 24 03:28:13.793085 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.792590 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" Jul 24 03:28:13.793085 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.792637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" event={"ID":"6fb3bb95-2a6a-4c76-9ef8-783d60925612","Type":"ContainerDied","Data":"50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b"} Jul 24 03:28:13.793085 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.792695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdbdf5bdd-2f8rw" event={"ID":"6fb3bb95-2a6a-4c76-9ef8-783d60925612","Type":"ContainerDied","Data":"8feba277db73922a93412316b06192a879dbfc55ffa0f0f1323f732ca85524e9"} Jul 24 03:28:13.793085 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.792731 2564 scope.go:117] "RemoveContainer" containerID="50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b" Jul 24 03:28:13.803019 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.802989 2564 scope.go:117] "RemoveContainer" containerID="50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b" Jul 24 03:28:13.804202 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:28:13.803378 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b\": container with ID starting with 50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b not found: ID does not exist" containerID="50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b" Jul 24 03:28:13.804202 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.803430 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b"} err="failed to get container status \"50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b\": rpc error: code = NotFound desc = could not find container \"50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b\": container with ID starting with 50a4673f89f0697df6ca6d41eef4f3d27dd3e68e66600e945d7fe8cfa9c1de0b not found: ID does not exist" Jul 24 03:28:13.820991 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.820960 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fdbdf5bdd-2f8rw"] Jul 24 03:28:13.830734 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:13.830707 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fdbdf5bdd-2f8rw"] Jul 24 03:28:15.050025 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:15.049993 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fb3bb95-2a6a-4c76-9ef8-783d60925612" path="/var/lib/kubelet/pods/6fb3bb95-2a6a-4c76-9ef8-783d60925612/volumes" Jul 24 03:28:36.079140 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.079102 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:28:36.863080 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.863040 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b67555fb4-f67l9"] Jul 24 03:28:36.863884 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.863861 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb3bb95-2a6a-4c76-9ef8-783d60925612" containerName="manager" Jul 24 03:28:36.863884 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.863887 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb3bb95-2a6a-4c76-9ef8-783d60925612" containerName="manager" Jul 24 03:28:36.864466 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.864033 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb3bb95-2a6a-4c76-9ef8-783d60925612" containerName="manager" Jul 24 03:28:36.868800 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.868774 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:36.871355 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.871329 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 24 03:28:36.871355 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.871344 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 24 03:28:36.872250 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.872228 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zf7c5\"" Jul 24 03:28:36.872369 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.872248 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 03:28:36.877697 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.877672 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b67555fb4-f67l9"] Jul 24 03:28:36.961854 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.961814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0234b858-d052-4fcc-afe4-4cd819101ebd-openshift-service-ca\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:36.961854 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.961858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0234b858-d052-4fcc-afe4-4cd819101ebd-maas-api-tls\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:36.962087 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:36.961985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6plbx\" (UniqueName: \"kubernetes.io/projected/0234b858-d052-4fcc-afe4-4cd819101ebd-kube-api-access-6plbx\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.063361 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.063334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0234b858-d052-4fcc-afe4-4cd819101ebd-openshift-service-ca\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.063560 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.063371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0234b858-d052-4fcc-afe4-4cd819101ebd-maas-api-tls\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.063560 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.063500 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6plbx\" (UniqueName: \"kubernetes.io/projected/0234b858-d052-4fcc-afe4-4cd819101ebd-kube-api-access-6plbx\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.063560 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:28:37.063542 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 24 03:28:37.063737 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:28:37.063632 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0234b858-d052-4fcc-afe4-4cd819101ebd-maas-api-tls podName:0234b858-d052-4fcc-afe4-4cd819101ebd nodeName:}" failed. No retries permitted until 2026-07-24 03:28:37.563608779 +0000 UTC m=+621.063112100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0234b858-d052-4fcc-afe4-4cd819101ebd-maas-api-tls") pod "maas-api-b67555fb4-f67l9" (UID: "0234b858-d052-4fcc-afe4-4cd819101ebd") : secret "maas-api-serving-cert" not found Jul 24 03:28:37.064118 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.064082 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0234b858-d052-4fcc-afe4-4cd819101ebd-openshift-service-ca\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.075391 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.075362 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6plbx\" (UniqueName: \"kubernetes.io/projected/0234b858-d052-4fcc-afe4-4cd819101ebd-kube-api-access-6plbx\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.339802 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.339771 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx"] Jul 24 03:28:37.342478 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.342461 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:37.345396 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.345373 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7x2lm\"" Jul 24 03:28:37.345660 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.345642 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 24 03:28:37.355049 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.355026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx"] Jul 24 03:28:37.362464 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.362408 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-6vdkb"] Jul 24 03:28:37.364673 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.364647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jssk\" (UniqueName: \"kubernetes.io/projected/5271a1af-df19-48c8-828b-437329abfb03-kube-api-access-5jssk\") pod \"payload-pre-processing-687dbb6cf6-x2hpx\" (UID: \"5271a1af-df19-48c8-828b-437329abfb03\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:37.364812 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.364699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5271a1af-df19-48c8-828b-437329abfb03-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-x2hpx\" (UID: \"5271a1af-df19-48c8-828b-437329abfb03\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:37.364942 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.364918 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:37.376275 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.376249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-6vdkb"] Jul 24 03:28:37.436584 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.436544 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:28:37.465449 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.465412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jssk\" (UniqueName: \"kubernetes.io/projected/5271a1af-df19-48c8-828b-437329abfb03-kube-api-access-5jssk\") pod \"payload-pre-processing-687dbb6cf6-x2hpx\" (UID: \"5271a1af-df19-48c8-828b-437329abfb03\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:37.465641 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.465455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a8aa7bd-169b-4bae-a08b-6742cf4750dc-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-6vdkb\" (UID: \"4a8aa7bd-169b-4bae-a08b-6742cf4750dc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:37.465641 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.465507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5271a1af-df19-48c8-828b-437329abfb03-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-x2hpx\" (UID: \"5271a1af-df19-48c8-828b-437329abfb03\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:37.465641 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.465617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmlhm\" (UniqueName: \"kubernetes.io/projected/4a8aa7bd-169b-4bae-a08b-6742cf4750dc-kube-api-access-cmlhm\") pod \"payload-processing-5cc6cd444b-6vdkb\" (UID: \"4a8aa7bd-169b-4bae-a08b-6742cf4750dc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:37.466262 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.466239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5271a1af-df19-48c8-828b-437329abfb03-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-x2hpx\" (UID: \"5271a1af-df19-48c8-828b-437329abfb03\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:37.473752 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.473723 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jssk\" (UniqueName: \"kubernetes.io/projected/5271a1af-df19-48c8-828b-437329abfb03-kube-api-access-5jssk\") pod \"payload-pre-processing-687dbb6cf6-x2hpx\" (UID: \"5271a1af-df19-48c8-828b-437329abfb03\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:37.566176 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.566140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmlhm\" (UniqueName: \"kubernetes.io/projected/4a8aa7bd-169b-4bae-a08b-6742cf4750dc-kube-api-access-cmlhm\") pod \"payload-processing-5cc6cd444b-6vdkb\" (UID: \"4a8aa7bd-169b-4bae-a08b-6742cf4750dc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:37.566396 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.566188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0234b858-d052-4fcc-afe4-4cd819101ebd-maas-api-tls\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.566396 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.566224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a8aa7bd-169b-4bae-a08b-6742cf4750dc-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-6vdkb\" (UID: \"4a8aa7bd-169b-4bae-a08b-6742cf4750dc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:37.567087 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.567054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a8aa7bd-169b-4bae-a08b-6742cf4750dc-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-6vdkb\" (UID: \"4a8aa7bd-169b-4bae-a08b-6742cf4750dc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:37.568978 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.568953 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0234b858-d052-4fcc-afe4-4cd819101ebd-maas-api-tls\") pod \"maas-api-b67555fb4-f67l9\" (UID: \"0234b858-d052-4fcc-afe4-4cd819101ebd\") " pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.574910 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.574887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmlhm\" (UniqueName: \"kubernetes.io/projected/4a8aa7bd-169b-4bae-a08b-6742cf4750dc-kube-api-access-cmlhm\") pod \"payload-processing-5cc6cd444b-6vdkb\" (UID: \"4a8aa7bd-169b-4bae-a08b-6742cf4750dc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:37.654537 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.654440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:37.676927 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.676895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:37.780743 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.780712 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:37.805389 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.805357 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx"] Jul 24 03:28:37.806052 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:28:37.806027 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5271a1af_df19_48c8_828b_437329abfb03.slice/crio-39a27d20588808322e4126ed8246d854fd25fb2117d668d2b9769cdc81e13f8b WatchSource:0}: Error finding container 39a27d20588808322e4126ed8246d854fd25fb2117d668d2b9769cdc81e13f8b: Status 404 returned error can't find the container with id 39a27d20588808322e4126ed8246d854fd25fb2117d668d2b9769cdc81e13f8b Jul 24 03:28:37.808871 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.808839 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 03:28:37.834586 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.834560 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-6vdkb"] Jul 24 03:28:37.836480 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:28:37.836451 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8aa7bd_169b_4bae_a08b_6742cf4750dc.slice/crio-c14957c030cacf4ee01b255a2a48128064914f2f3ab5f090304027bff9f3fc24 WatchSource:0}: Error finding container c14957c030cacf4ee01b255a2a48128064914f2f3ab5f090304027bff9f3fc24: Status 404 returned error can't find the container with id c14957c030cacf4ee01b255a2a48128064914f2f3ab5f090304027bff9f3fc24 Jul 24 03:28:37.913395 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.913316 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" event={"ID":"5271a1af-df19-48c8-828b-437329abfb03","Type":"ContainerStarted","Data":"39a27d20588808322e4126ed8246d854fd25fb2117d668d2b9769cdc81e13f8b"} Jul 24 03:28:37.914444 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.914414 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" event={"ID":"4a8aa7bd-169b-4bae-a08b-6742cf4750dc","Type":"ContainerStarted","Data":"c14957c030cacf4ee01b255a2a48128064914f2f3ab5f090304027bff9f3fc24"} Jul 24 03:28:37.948096 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:37.948068 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b67555fb4-f67l9"] Jul 24 03:28:37.950261 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:28:37.950231 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0234b858_d052_4fcc_afe4_4cd819101ebd.slice/crio-c7cff06f5784744163116f75bae038c10e809739762099979b5f4a448416e586 WatchSource:0}: Error finding container c7cff06f5784744163116f75bae038c10e809739762099979b5f4a448416e586: Status 404 returned error can't find the container with id c7cff06f5784744163116f75bae038c10e809739762099979b5f4a448416e586 Jul 24 03:28:38.924652 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:38.924614 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" event={"ID":"0234b858-d052-4fcc-afe4-4cd819101ebd","Type":"ContainerStarted","Data":"c7cff06f5784744163116f75bae038c10e809739762099979b5f4a448416e586"} Jul 24 03:28:40.936845 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:40.936806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" event={"ID":"4a8aa7bd-169b-4bae-a08b-6742cf4750dc","Type":"ContainerStarted","Data":"9c3bee0ad1cbcaa67a1ac732ec5481cf6bcabf82a202b83fa990c6cf93a30f8b"} Jul 24 03:28:40.937382 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:40.936996 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:28:40.938474 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:40.938446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" event={"ID":"0234b858-d052-4fcc-afe4-4cd819101ebd","Type":"ContainerStarted","Data":"09b30dfb30427d7973a025e8b49971b3e6b9a59e321cc39247b72fc98d68ab29"} Jul 24 03:28:40.938616 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:40.938534 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:40.940073 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:40.940036 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" event={"ID":"5271a1af-df19-48c8-828b-437329abfb03","Type":"ContainerStarted","Data":"5c8ff5f64943bd889b00c623eabfe54db0be770d952080de9c42096593535aa4"} Jul 24 03:28:40.940204 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:40.940143 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:40.964142 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:40.964084 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" podStartSLOduration=1.8777828030000001 podStartE2EDuration="3.964066805s" totalImagesPullingTime="2.086284002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:28:40.954507805 +0000 UTC m=+624.454011183" watchObservedRunningTime="2026-07-24 03:28:40.964066805 +0000 UTC m=+624.463570145" Jul 24 03:28:40.980618 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:40.980567 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" podStartSLOduration=1.869994097 podStartE2EDuration="3.980551972s" totalImagesPullingTime="2.110557875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:28:40.978781335 +0000 UTC m=+624.478284675" watchObservedRunningTime="2026-07-24 03:28:40.980551972 +0000 UTC m=+624.480055312" Jul 24 03:28:41.004587 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:41.004532 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" podStartSLOduration=3.037125543 podStartE2EDuration="5.004514437s" totalImagesPullingTime="1.967388894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:28:41.001613742 +0000 UTC m=+624.501117095" watchObservedRunningTime="2026-07-24 03:28:41.004514437 +0000 UTC m=+624.504017796" Jul 24 03:28:46.950427 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:46.950397 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b67555fb4-f67l9" Jul 24 03:28:47.974752 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:47.974708 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:28:48.068748 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:48.068719 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:28:51.946868 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:51.946840 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-x2hpx" Jul 24 03:28:51.947362 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:28:51.946914 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-6vdkb" Jul 24 03:29:06.990489 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:06.990458 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:29:22.880064 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:22.880028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:29:32.866337 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.866270 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p"] Jul 24 03:29:32.869070 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.869052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:32.871479 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.871457 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 03:29:32.871602 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.871459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 03:29:32.872242 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.872221 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kdtrl\"" Jul 24 03:29:32.872363 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.872259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 24 03:29:32.879625 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.879603 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p"] Jul 24 03:29:32.958795 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.958765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:32.958795 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.958800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:32.959050 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.958851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:32.959050 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.958937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5qm\" (UniqueName: \"kubernetes.io/projected/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-kube-api-access-2l5qm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:32.959050 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.958964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:32.959050 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.959032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:32.959494 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:32.959468 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:29:33.060460 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.060427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5qm\" (UniqueName: \"kubernetes.io/projected/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-kube-api-access-2l5qm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.060460 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.060466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.060711 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.060504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.060711 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.060542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.060711 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.060559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.060711 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.060592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.060964 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.060943 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.061050 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.060998 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.061050 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.061030 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.062936 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.062912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.063220 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.063198 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.068869 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.068843 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5qm\" (UniqueName: \"kubernetes.io/projected/6a93eecd-fc0e-4b75-af44-b57dc9f1c05a-kube-api-access-2l5qm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h8r8p\" (UID: \"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.180411 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.180273 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:33.317778 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:33.317753 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p"] Jul 24 03:29:33.319346 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:29:33.319317 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a93eecd_fc0e_4b75_af44_b57dc9f1c05a.slice/crio-ad07da903119a58d5ce7f619c68867d6c7c5504a7222d67e8ec8efffb9026bdd WatchSource:0}: Error finding container ad07da903119a58d5ce7f619c68867d6c7c5504a7222d67e8ec8efffb9026bdd: Status 404 returned error can't find the container with id ad07da903119a58d5ce7f619c68867d6c7c5504a7222d67e8ec8efffb9026bdd Jul 24 03:29:34.202166 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:34.202132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" event={"ID":"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a","Type":"ContainerStarted","Data":"ad07da903119a58d5ce7f619c68867d6c7c5504a7222d67e8ec8efffb9026bdd"} Jul 24 03:29:35.208322 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:35.208263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" event={"ID":"6a93eecd-fc0e-4b75-af44-b57dc9f1c05a","Type":"ContainerStarted","Data":"08ea48a09d2df7089a7e58c4e7722f3f338ba8c341e0e60713f5c2a238f36f2f"} Jul 24 03:29:35.226043 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:35.225987 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" podStartSLOduration=2.286960988 podStartE2EDuration="3.225969426s" totalImagesPullingTime="939.008438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:29:35.22449636 +0000 UTC m=+678.723999721" watchObservedRunningTime="2026-07-24 03:29:35.225969426 +0000 UTC m=+678.725472760" Jul 24 03:29:41.606127 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:41.606089 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:29:43.180747 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:43.180710 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:43.181181 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:43.180780 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:43.193502 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:43.193472 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:43.259232 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:43.259204 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h8r8p" Jul 24 03:29:51.490177 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:51.490142 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:29:57.358046 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.358011 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h"] Jul 24 03:29:57.360527 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.360509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.362913 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.362888 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 24 03:29:57.369504 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.369480 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h"] Jul 24 03:29:57.385088 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.385055 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:29:57.485046 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.485012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.485046 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.485055 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5g4t\" (UniqueName: \"kubernetes.io/projected/7eaec4e0-0b87-4091-9494-63d59789a504-kube-api-access-f5g4t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.485283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.485086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.485283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.485103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.485283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.485224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eaec4e0-0b87-4091-9494-63d59789a504-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.485283 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.485248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.586487 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.586444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eaec4e0-0b87-4091-9494-63d59789a504-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.586487 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.586488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.586700 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.586552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.586700 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.586579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5g4t\" (UniqueName: \"kubernetes.io/projected/7eaec4e0-0b87-4091-9494-63d59789a504-kube-api-access-f5g4t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.586700 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.586627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.586700 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.586650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.587044 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.587022 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.587102 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.587039 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.587155 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.587105 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.588958 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.588926 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eaec4e0-0b87-4091-9494-63d59789a504-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.589185 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.589169 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eaec4e0-0b87-4091-9494-63d59789a504-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.594332 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.594307 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5g4t\" (UniqueName: \"kubernetes.io/projected/7eaec4e0-0b87-4091-9494-63d59789a504-kube-api-access-f5g4t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-76q8h\" (UID: \"7eaec4e0-0b87-4091-9494-63d59789a504\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.672912 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.672825 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:29:57.813059 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:57.813033 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h"] Jul 24 03:29:57.815169 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:29:57.815142 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eaec4e0_0b87_4091_9494_63d59789a504.slice/crio-49235dd4702cb92d782cf10fddeaae218f1a5d9ca51b5edec6a80218d7929c64 WatchSource:0}: Error finding container 49235dd4702cb92d782cf10fddeaae218f1a5d9ca51b5edec6a80218d7929c64: Status 404 returned error can't find the container with id 49235dd4702cb92d782cf10fddeaae218f1a5d9ca51b5edec6a80218d7929c64 Jul 24 03:29:58.326461 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:58.326420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" event={"ID":"7eaec4e0-0b87-4091-9494-63d59789a504","Type":"ContainerStarted","Data":"960b73d65c037209da8da0eccdf8e5714eb79b76eca9257441896b303f571252"} Jul 24 03:29:58.326657 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:58.326471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" event={"ID":"7eaec4e0-0b87-4091-9494-63d59789a504","Type":"ContainerStarted","Data":"49235dd4702cb92d782cf10fddeaae218f1a5d9ca51b5edec6a80218d7929c64"} Jul 24 03:29:58.344110 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:29:58.344050 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" podStartSLOduration=1.1672713 podStartE2EDuration="1.344035499s" totalImagesPullingTime="176.764199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:29:58.342135496 +0000 UTC m=+701.841638836" watchObservedRunningTime="2026-07-24 03:29:58.344035499 +0000 UTC m=+701.843538839" Jul 24 03:30:05.296053 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:05.296022 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:30:07.673087 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:07.673053 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:30:07.673504 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:07.673141 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:30:07.686660 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:07.686629 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:30:08.386079 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:08.386002 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-76q8h" Jul 24 03:30:47.491758 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:47.491721 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:30:57.389318 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:57.389261 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:30:57.482415 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:57.482379 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:30:58.549306 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:58.549262 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:30:58.642155 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:30:58.642110 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:31:46.367860 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.367753 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8485f56769-2sk7k"] Jul 24 03:31:46.368453 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.368022 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8485f56769-2sk7k" podUID="dbdb1e45-8a42-4596-8afb-2c616847a7a2" containerName="manager" containerID="cri-o://32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa" gracePeriod=30 Jul 24 03:31:46.618225 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.618157 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:31:46.679942 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.679907 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbdb1e45-8a42-4596-8afb-2c616847a7a2-webhook-cert\") pod \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\" (UID: \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\") " Jul 24 03:31:46.680109 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.679970 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngmnq\" (UniqueName: \"kubernetes.io/projected/dbdb1e45-8a42-4596-8afb-2c616847a7a2-kube-api-access-ngmnq\") pod \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\" (UID: \"dbdb1e45-8a42-4596-8afb-2c616847a7a2\") " Jul 24 03:31:46.682006 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.681974 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbdb1e45-8a42-4596-8afb-2c616847a7a2-kube-api-access-ngmnq" (OuterVolumeSpecName: "kube-api-access-ngmnq") pod "dbdb1e45-8a42-4596-8afb-2c616847a7a2" (UID: "dbdb1e45-8a42-4596-8afb-2c616847a7a2"). InnerVolumeSpecName "kube-api-access-ngmnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:31:46.682122 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.682003 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbdb1e45-8a42-4596-8afb-2c616847a7a2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dbdb1e45-8a42-4596-8afb-2c616847a7a2" (UID: "dbdb1e45-8a42-4596-8afb-2c616847a7a2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:31:46.781428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.781381 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbdb1e45-8a42-4596-8afb-2c616847a7a2-webhook-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:31:46.781428 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.781424 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngmnq\" (UniqueName: \"kubernetes.io/projected/dbdb1e45-8a42-4596-8afb-2c616847a7a2-kube-api-access-ngmnq\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:31:46.888398 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.888314 2564 generic.go:356] "Generic (PLEG): container finished" podID="dbdb1e45-8a42-4596-8afb-2c616847a7a2" containerID="32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa" exitCode=0 Jul 24 03:31:46.888398 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.888360 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-2sk7k" Jul 24 03:31:46.888398 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.888369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-2sk7k" event={"ID":"dbdb1e45-8a42-4596-8afb-2c616847a7a2","Type":"ContainerDied","Data":"32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa"} Jul 24 03:31:46.888621 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.888419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-2sk7k" event={"ID":"dbdb1e45-8a42-4596-8afb-2c616847a7a2","Type":"ContainerDied","Data":"218346496f84acf2f575f9d55e732683ef58a6ce12894606efa27e24d9726e29"} Jul 24 03:31:46.888621 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.888444 2564 scope.go:117] "RemoveContainer" containerID="32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa" Jul 24 03:31:46.897901 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.897881 2564 scope.go:117] "RemoveContainer" containerID="32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa" Jul 24 03:31:46.898207 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:31:46.898190 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa\": container with ID starting with 32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa not found: ID does not exist" containerID="32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa" Jul 24 03:31:46.898248 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.898219 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa"} err="failed to get container status \"32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa\": rpc error: code = NotFound desc = could not find container \"32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa\": container with ID starting with 32120418524d2cf84f4ed79a2676c68c4a59006ac3a15cdc0c54b132b6ecebfa not found: ID does not exist" Jul 24 03:31:46.911087 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.911051 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8485f56769-2sk7k"] Jul 24 03:31:46.913058 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:46.913036 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8485f56769-2sk7k"] Jul 24 03:31:47.056564 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:31:47.056532 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbdb1e45-8a42-4596-8afb-2c616847a7a2" path="/var/lib/kubelet/pods/dbdb1e45-8a42-4596-8afb-2c616847a7a2/volumes" Jul 24 03:32:00.923746 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:00.923711 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:32:01.024030 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:01.023997 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:32:47.739247 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.739210 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8485f56769-6tkqx"] Jul 24 03:32:47.739796 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.739588 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbdb1e45-8a42-4596-8afb-2c616847a7a2" containerName="manager" Jul 24 03:32:47.739796 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.739600 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbdb1e45-8a42-4596-8afb-2c616847a7a2" containerName="manager" Jul 24 03:32:47.739796 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.739678 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbdb1e45-8a42-4596-8afb-2c616847a7a2" containerName="manager" Jul 24 03:32:47.742908 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.742889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:47.745406 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.745385 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ngcwl\"" Jul 24 03:32:47.746221 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.746204 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 24 03:32:47.746277 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.746197 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 24 03:32:47.752511 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.752487 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8485f56769-6tkqx"] Jul 24 03:32:47.808661 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.808618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4gx9\" (UniqueName: \"kubernetes.io/projected/eb8e9c4f-6444-4e31-b949-414f4a61d166-kube-api-access-h4gx9\") pod \"maas-controller-8485f56769-6tkqx\" (UID: \"eb8e9c4f-6444-4e31-b949-414f4a61d166\") " pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:47.808837 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.808699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb8e9c4f-6444-4e31-b949-414f4a61d166-webhook-cert\") pod \"maas-controller-8485f56769-6tkqx\" (UID: \"eb8e9c4f-6444-4e31-b949-414f4a61d166\") " pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:47.909124 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.909084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4gx9\" (UniqueName: \"kubernetes.io/projected/eb8e9c4f-6444-4e31-b949-414f4a61d166-kube-api-access-h4gx9\") pod \"maas-controller-8485f56769-6tkqx\" (UID: \"eb8e9c4f-6444-4e31-b949-414f4a61d166\") " pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:47.909248 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.909171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb8e9c4f-6444-4e31-b949-414f4a61d166-webhook-cert\") pod \"maas-controller-8485f56769-6tkqx\" (UID: \"eb8e9c4f-6444-4e31-b949-414f4a61d166\") " pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:47.911598 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.911568 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb8e9c4f-6444-4e31-b949-414f4a61d166-webhook-cert\") pod \"maas-controller-8485f56769-6tkqx\" (UID: \"eb8e9c4f-6444-4e31-b949-414f4a61d166\") " pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:47.922081 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:47.922052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4gx9\" (UniqueName: \"kubernetes.io/projected/eb8e9c4f-6444-4e31-b949-414f4a61d166-kube-api-access-h4gx9\") pod \"maas-controller-8485f56769-6tkqx\" (UID: \"eb8e9c4f-6444-4e31-b949-414f4a61d166\") " pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:48.055033 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:48.054943 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:48.401912 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:48.401886 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8485f56769-6tkqx"] Jul 24 03:32:48.404547 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:32:48.404517 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8e9c4f_6444_4e31_b949_414f4a61d166.slice/crio-a5270e997ba1efa119cf12cc4a4f5366824bb3724e84f6e1e5c8626528ae6690 WatchSource:0}: Error finding container a5270e997ba1efa119cf12cc4a4f5366824bb3724e84f6e1e5c8626528ae6690: Status 404 returned error can't find the container with id a5270e997ba1efa119cf12cc4a4f5366824bb3724e84f6e1e5c8626528ae6690 Jul 24 03:32:49.206823 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:49.206779 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-6tkqx" event={"ID":"eb8e9c4f-6444-4e31-b949-414f4a61d166","Type":"ContainerStarted","Data":"0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04"} Jul 24 03:32:49.207235 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:49.206949 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:32:49.207235 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:49.206994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-6tkqx" event={"ID":"eb8e9c4f-6444-4e31-b949-414f4a61d166","Type":"ContainerStarted","Data":"a5270e997ba1efa119cf12cc4a4f5366824bb3724e84f6e1e5c8626528ae6690"} Jul 24 03:32:49.225997 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:49.225942 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8485f56769-6tkqx" podStartSLOduration=1.605856701 podStartE2EDuration="2.225924271s" totalImagesPullingTime="620.06757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:32:49.223514577 +0000 UTC m=+872.723017938" watchObservedRunningTime="2026-07-24 03:32:49.225924271 +0000 UTC m=+872.725427612" Jul 24 03:32:54.569327 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:54.569277 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:32:54.621994 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:32:54.621956 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:00.214955 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:00.214922 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:33:04.745643 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:04.745605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:04.849040 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:04.849005 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8485f56769-6tkqx"] Jul 24 03:33:04.849221 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:04.849201 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8485f56769-6tkqx" podUID="eb8e9c4f-6444-4e31-b949-414f4a61d166" containerName="manager" containerID="cri-o://0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04" gracePeriod=30 Jul 24 03:33:05.102716 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.102691 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:33:05.159750 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.159715 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb8e9c4f-6444-4e31-b949-414f4a61d166-webhook-cert\") pod \"eb8e9c4f-6444-4e31-b949-414f4a61d166\" (UID: \"eb8e9c4f-6444-4e31-b949-414f4a61d166\") " Jul 24 03:33:05.160007 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.159830 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4gx9\" (UniqueName: \"kubernetes.io/projected/eb8e9c4f-6444-4e31-b949-414f4a61d166-kube-api-access-h4gx9\") pod \"eb8e9c4f-6444-4e31-b949-414f4a61d166\" (UID: \"eb8e9c4f-6444-4e31-b949-414f4a61d166\") " Jul 24 03:33:05.161752 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.161722 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8e9c4f-6444-4e31-b949-414f4a61d166-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eb8e9c4f-6444-4e31-b949-414f4a61d166" (UID: "eb8e9c4f-6444-4e31-b949-414f4a61d166"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:33:05.161871 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.161850 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8e9c4f-6444-4e31-b949-414f4a61d166-kube-api-access-h4gx9" (OuterVolumeSpecName: "kube-api-access-h4gx9") pod "eb8e9c4f-6444-4e31-b949-414f4a61d166" (UID: "eb8e9c4f-6444-4e31-b949-414f4a61d166"). InnerVolumeSpecName "kube-api-access-h4gx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:33:05.260985 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.260940 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4gx9\" (UniqueName: \"kubernetes.io/projected/eb8e9c4f-6444-4e31-b949-414f4a61d166-kube-api-access-h4gx9\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:33:05.260985 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.260977 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb8e9c4f-6444-4e31-b949-414f4a61d166-webhook-cert\") on node \"ip-10-0-134-231.ec2.internal\" DevicePath \"\"" Jul 24 03:33:05.292931 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.292844 2564 generic.go:356] "Generic (PLEG): container finished" podID="eb8e9c4f-6444-4e31-b949-414f4a61d166" containerID="0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04" exitCode=0 Jul 24 03:33:05.292931 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.292882 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-6tkqx" event={"ID":"eb8e9c4f-6444-4e31-b949-414f4a61d166","Type":"ContainerDied","Data":"0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04"} Jul 24 03:33:05.292931 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.292887 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-6tkqx" Jul 24 03:33:05.292931 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.292924 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-6tkqx" event={"ID":"eb8e9c4f-6444-4e31-b949-414f4a61d166","Type":"ContainerDied","Data":"a5270e997ba1efa119cf12cc4a4f5366824bb3724e84f6e1e5c8626528ae6690"} Jul 24 03:33:05.293211 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.292968 2564 scope.go:117] "RemoveContainer" containerID="0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04" Jul 24 03:33:05.302477 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.302454 2564 scope.go:117] "RemoveContainer" containerID="0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04" Jul 24 03:33:05.302776 ip-10-0-134-231 kubenswrapper[2564]: E0724 03:33:05.302760 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04\": container with ID starting with 0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04 not found: ID does not exist" containerID="0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04" Jul 24 03:33:05.302815 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.302785 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04"} err="failed to get container status \"0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04\": rpc error: code = NotFound desc = could not find container \"0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04\": container with ID starting with 0a501b1e90036e9d7e8b21df86cb523ac742f70d7139744540ae5413ecf7fb04 not found: ID does not exist" Jul 24 03:33:05.316005 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.315978 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8485f56769-6tkqx"] Jul 24 03:33:05.319818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:05.319794 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8485f56769-6tkqx"] Jul 24 03:33:06.008360 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.008325 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:06.111064 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.111033 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8485f56769-nbkts"] Jul 24 03:33:06.111436 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.111423 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8e9c4f-6444-4e31-b949-414f4a61d166" containerName="manager" Jul 24 03:33:06.111496 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.111437 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8e9c4f-6444-4e31-b949-414f4a61d166" containerName="manager" Jul 24 03:33:06.111534 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.111501 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8e9c4f-6444-4e31-b949-414f4a61d166" containerName="manager" Jul 24 03:33:06.115714 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.115698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:06.119147 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.119088 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 24 03:33:06.119147 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.119101 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ngcwl\"" Jul 24 03:33:06.119319 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.119099 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 24 03:33:06.123728 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.123695 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8485f56769-nbkts"] Jul 24 03:33:06.270510 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.270477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d7be892-2ed0-452b-b6ab-82cad1f74c0b-webhook-cert\") pod \"maas-controller-8485f56769-nbkts\" (UID: \"9d7be892-2ed0-452b-b6ab-82cad1f74c0b\") " pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:06.270698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.270605 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5nv8\" (UniqueName: \"kubernetes.io/projected/9d7be892-2ed0-452b-b6ab-82cad1f74c0b-kube-api-access-d5nv8\") pod \"maas-controller-8485f56769-nbkts\" (UID: \"9d7be892-2ed0-452b-b6ab-82cad1f74c0b\") " pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:06.371359 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.371267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5nv8\" (UniqueName: \"kubernetes.io/projected/9d7be892-2ed0-452b-b6ab-82cad1f74c0b-kube-api-access-d5nv8\") pod \"maas-controller-8485f56769-nbkts\" (UID: \"9d7be892-2ed0-452b-b6ab-82cad1f74c0b\") " pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:06.371528 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.371360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d7be892-2ed0-452b-b6ab-82cad1f74c0b-webhook-cert\") pod \"maas-controller-8485f56769-nbkts\" (UID: \"9d7be892-2ed0-452b-b6ab-82cad1f74c0b\") " pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:06.373718 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.373698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d7be892-2ed0-452b-b6ab-82cad1f74c0b-webhook-cert\") pod \"maas-controller-8485f56769-nbkts\" (UID: \"9d7be892-2ed0-452b-b6ab-82cad1f74c0b\") " pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:06.380170 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.380141 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5nv8\" (UniqueName: \"kubernetes.io/projected/9d7be892-2ed0-452b-b6ab-82cad1f74c0b-kube-api-access-d5nv8\") pod \"maas-controller-8485f56769-nbkts\" (UID: \"9d7be892-2ed0-452b-b6ab-82cad1f74c0b\") " pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:06.427978 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.427943 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:06.567347 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:06.567323 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8485f56769-nbkts"] Jul 24 03:33:06.568845 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:33:06.568824 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7be892_2ed0_452b_b6ab_82cad1f74c0b.slice/crio-81957e41136d4ff8801d7682f55545765a400b5b5a26e637add5c83f6965e136 WatchSource:0}: Error finding container 81957e41136d4ff8801d7682f55545765a400b5b5a26e637add5c83f6965e136: Status 404 returned error can't find the container with id 81957e41136d4ff8801d7682f55545765a400b5b5a26e637add5c83f6965e136 Jul 24 03:33:07.051928 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:07.051895 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8e9c4f-6444-4e31-b949-414f4a61d166" path="/var/lib/kubelet/pods/eb8e9c4f-6444-4e31-b949-414f4a61d166/volumes" Jul 24 03:33:07.307326 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:07.307206 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-nbkts" event={"ID":"9d7be892-2ed0-452b-b6ab-82cad1f74c0b","Type":"ContainerStarted","Data":"6c01fba980f041349e44fb22b1c7b89fe5970060697d352d5bfd0cc3d74f55f5"} Jul 24 03:33:07.307326 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:07.307271 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:07.307326 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:07.307314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8485f56769-nbkts" event={"ID":"9d7be892-2ed0-452b-b6ab-82cad1f74c0b","Type":"ContainerStarted","Data":"81957e41136d4ff8801d7682f55545765a400b5b5a26e637add5c83f6965e136"} Jul 24 03:33:07.327675 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:07.327620 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8485f56769-nbkts" podStartSLOduration=0.780359968 podStartE2EDuration="1.327604564s" totalImagesPullingTime="547.244596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:33:07.327080744 +0000 UTC m=+890.826584095" watchObservedRunningTime="2026-07-24 03:33:07.327604564 +0000 UTC m=+890.827107904" Jul 24 03:33:18.315698 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:18.315668 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8485f56769-nbkts" Jul 24 03:33:18.682475 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:18.682394 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:18.782494 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:18.782466 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:48.599942 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:48.599901 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:49.859967 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:49.859931 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:54.603156 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:54.603120 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:54.666366 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:54.666332 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:54.733987 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:54.733949 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:54.834459 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:54.834426 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:33:54.959464 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:33:54.959369 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:34:00.654454 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:34:00.654421 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:34:00.721912 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:34:00.721878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:36:24.666877 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:36:24.666798 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:41:18.584973 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:41:18.584936 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:41:28.034226 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:41:28.034191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:41:28.089574 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:41:28.089536 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:41:35.318391 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:41:35.318353 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:41:46.480035 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:41:46.479988 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:41:55.100915 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:41:55.100881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:42:25.500870 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:42:25.500783 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:42:25.710799 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:42:25.710763 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:45:38.952644 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:38.952603 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8485f56769-nbkts_9d7be892-2ed0-452b-b6ab-82cad1f74c0b/manager/0.log" Jul 24 03:45:39.562819 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:39.562789 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75c644cf-rz2xp_33fb4595-ddcd-419d-9cb3-8a538698f6c0/copy-manifests/0.log" Jul 24 03:45:39.569833 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:39.569803 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75c644cf-rz2xp_33fb4595-ddcd-419d-9cb3-8a538698f6c0/manager/0.log" Jul 24 03:45:39.916216 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:39.916109 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-b67555fb4-f67l9_0234b858-d052-4fcc-afe4-4cd819101ebd/maas-api/0.log" Jul 24 03:45:41.019609 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.019581 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5_493315ab-d8fc-410a-8b44-5efc930db9c3/extract/0.log" Jul 24 03:45:41.025284 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.025233 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5_493315ab-d8fc-410a-8b44-5efc930db9c3/util/0.log" Jul 24 03:45:41.031792 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.031766 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5_493315ab-d8fc-410a-8b44-5efc930db9c3/pull/0.log" Jul 24 03:45:41.147267 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.147236 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs_6f61a086-7f9c-4a80-8e52-d37c820c7d9f/util/0.log" Jul 24 03:45:41.154173 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.154149 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs_6f61a086-7f9c-4a80-8e52-d37c820c7d9f/pull/0.log" Jul 24 03:45:41.160997 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.160966 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs_6f61a086-7f9c-4a80-8e52-d37c820c7d9f/extract/0.log" Jul 24 03:45:41.274608 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.274525 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j_98f9da71-89c2-4e3e-b0d4-9016eee4dfb1/util/0.log" Jul 24 03:45:41.280638 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.280613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j_98f9da71-89c2-4e3e-b0d4-9016eee4dfb1/pull/0.log" Jul 24 03:45:41.289306 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.289270 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j_98f9da71-89c2-4e3e-b0d4-9016eee4dfb1/extract/0.log" Jul 24 03:45:41.414120 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.414094 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds_0efcc6cf-c573-4c6f-9e73-b926e2746c2e/util/0.log" Jul 24 03:45:41.423385 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.423360 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds_0efcc6cf-c573-4c6f-9e73-b926e2746c2e/pull/0.log" Jul 24 03:45:41.430450 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:41.430426 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds_0efcc6cf-c573-4c6f-9e73-b926e2746c2e/extract/0.log" Jul 24 03:45:42.749818 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:42.749777 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd_38f949c8-30af-47c0-9053-342ae8a6d69f/istio-proxy/0.log" Jul 24 03:45:42.875858 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:42.875818 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-ng5mq_81ef12de-6f0a-4909-89f8-6dddf145a627/discovery/0.log" Jul 24 03:45:43.354345 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:43.354311 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-x2hpx_5271a1af-df19-48c8-828b-437329abfb03/payload-pre-processing/0.log" Jul 24 03:45:43.478076 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:43.478041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6vdkb_4a8aa7bd-169b-4bae-a08b-6742cf4750dc/payload-processing/0.log" Jul 24 03:45:44.167982 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:44.167950 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-h8r8p_6a93eecd-fc0e-4b75-af44-b57dc9f1c05a/main/0.log" Jul 24 03:45:44.405800 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:44.405773 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-76q8h_7eaec4e0-0b87-4091-9494-63d59789a504/main/0.log" Jul 24 03:45:50.468803 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:50.468765 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:45:50.546914 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:50.546881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" limit=1024 Jul 24 03:45:53.335492 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:53.335443 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vm9zb_a10e2dae-e163-47bc-8954-b521f5fa6808/global-pull-secret-syncer/0.log" Jul 24 03:45:53.382077 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:53.382041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8vzrn_965b976e-9f19-44eb-8762-c8b1a4aec264/konnectivity-agent/0.log" Jul 24 03:45:53.464665 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:53.464633 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-231.ec2.internal_6a396f40636e367bf35305e84479730c/haproxy/0.log" Jul 24 03:45:57.829381 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:57.829346 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5_493315ab-d8fc-410a-8b44-5efc930db9c3/extract/0.log" Jul 24 03:45:57.852756 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:57.852722 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5_493315ab-d8fc-410a-8b44-5efc930db9c3/util/0.log" Jul 24 03:45:57.869039 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:57.869012 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jxxl5_493315ab-d8fc-410a-8b44-5efc930db9c3/pull/0.log" Jul 24 03:45:57.898502 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:57.898476 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs_6f61a086-7f9c-4a80-8e52-d37c820c7d9f/extract/0.log" Jul 24 03:45:57.927864 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:57.927827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs_6f61a086-7f9c-4a80-8e52-d37c820c7d9f/util/0.log" Jul 24 03:45:57.951514 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:57.951482 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0srmfs_6f61a086-7f9c-4a80-8e52-d37c820c7d9f/pull/0.log" Jul 24 03:45:57.973343 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:57.973323 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j_98f9da71-89c2-4e3e-b0d4-9016eee4dfb1/extract/0.log" Jul 24 03:45:57.993253 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:57.993225 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j_98f9da71-89c2-4e3e-b0d4-9016eee4dfb1/util/0.log" Jul 24 03:45:58.014503 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:58.014462 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd44j_98f9da71-89c2-4e3e-b0d4-9016eee4dfb1/pull/0.log" Jul 24 03:45:58.039953 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:58.039822 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds_0efcc6cf-c573-4c6f-9e73-b926e2746c2e/extract/0.log" Jul 24 03:45:58.062403 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:58.062375 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds_0efcc6cf-c573-4c6f-9e73-b926e2746c2e/util/0.log" Jul 24 03:45:58.102245 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:45:58.102153 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q6ds_0efcc6cf-c573-4c6f-9e73-b926e2746c2e/pull/0.log" Jul 24 03:46:01.115832 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:01.115798 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-wdg5m_654a3789-1c1f-435d-9d55-b3bec3c0d67a/kube-state-metrics/0.log" Jul 24 03:46:01.163523 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:01.163497 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-wdg5m_654a3789-1c1f-435d-9d55-b3bec3c0d67a/kube-rbac-proxy-main/0.log" Jul 24 03:46:01.227284 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:01.227252 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-wdg5m_654a3789-1c1f-435d-9d55-b3bec3c0d67a/kube-rbac-proxy-self/0.log" Jul 24 03:46:01.333402 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:01.333376 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-nbs44_038e38a6-03da-4f01-a29d-6d9ce17473f9/monitoring-plugin/0.log" Jul 24 03:46:01.723572 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:01.723539 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtz7z_4521334e-c39c-4852-91e3-a7e734af80d5/node-exporter/0.log" Jul 24 03:46:01.761686 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:01.761658 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtz7z_4521334e-c39c-4852-91e3-a7e734af80d5/kube-rbac-proxy/0.log" Jul 24 03:46:01.794926 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:01.794900 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtz7z_4521334e-c39c-4852-91e3-a7e734af80d5/init-textfile/0.log" Jul 24 03:46:02.208010 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.207970 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65dc648fc5-nmxw7_98e161c1-e595-4c42-af2f-4d52521f3602/telemeter-client/0.log" Jul 24 03:46:02.257741 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.257687 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65dc648fc5-nmxw7_98e161c1-e595-4c42-af2f-4d52521f3602/reload/0.log" Jul 24 03:46:02.291753 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.291724 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65dc648fc5-nmxw7_98e161c1-e595-4c42-af2f-4d52521f3602/kube-rbac-proxy/0.log" Jul 24 03:46:02.346002 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.345974 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8979b4c6-4fmlw_7a051985-d681-4173-a8b6-f58a31ad6586/thanos-query/0.log" Jul 24 03:46:02.401720 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.401690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8979b4c6-4fmlw_7a051985-d681-4173-a8b6-f58a31ad6586/kube-rbac-proxy-web/0.log" Jul 24 03:46:02.457390 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.457360 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8979b4c6-4fmlw_7a051985-d681-4173-a8b6-f58a31ad6586/kube-rbac-proxy/0.log" Jul 24 03:46:02.507065 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.506980 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8979b4c6-4fmlw_7a051985-d681-4173-a8b6-f58a31ad6586/prom-label-proxy/0.log" Jul 24 03:46:02.563140 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.563113 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8979b4c6-4fmlw_7a051985-d681-4173-a8b6-f58a31ad6586/kube-rbac-proxy-rules/0.log" Jul 24 03:46:02.628142 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.628099 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c8979b4c6-4fmlw_7a051985-d681-4173-a8b6-f58a31ad6586/kube-rbac-proxy-metrics/0.log" Jul 24 03:46:02.968840 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.968812 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v"] Jul 24 03:46:02.972421 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.972395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:02.978325 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.978279 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f2589\"/\"kube-root-ca.crt\"" Jul 24 03:46:02.978520 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.978490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f2589\"/\"default-dockercfg-294hf\"" Jul 24 03:46:02.978738 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:02.978724 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f2589\"/\"openshift-service-ca.crt\"" Jul 24 03:46:03.013230 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.013194 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v"] Jul 24 03:46:03.013492 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.013471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-proc\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.013557 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.013509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klc6v\" (UniqueName: \"kubernetes.io/projected/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-kube-api-access-klc6v\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.013557 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.013551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-lib-modules\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.013663 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.013641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-podres\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.013718 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.013675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-sys\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114521 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-lib-modules\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-podres\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-sys\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-proc\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klc6v\" (UniqueName: \"kubernetes.io/projected/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-kube-api-access-klc6v\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114678 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-lib-modules\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114679 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-podres\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-sys\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.114726 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.114726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-proc\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.131619 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.131590 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klc6v\" (UniqueName: \"kubernetes.io/projected/5c9845fe-b77d-4c2d-84fc-fed6aae59b0d-kube-api-access-klc6v\") pod \"perf-node-gather-daemonset-g8j4v\" (UID: \"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.282321 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.282200 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:03.429467 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:03.429432 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v"] Jul 24 03:46:03.432905 ip-10-0-134-231 kubenswrapper[2564]: W0724 03:46:03.432873 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c9845fe_b77d_4c2d_84fc_fed6aae59b0d.slice/crio-031047576db4d7747ca909fb5ce64700e27f23cd4a4f1bd542e32ffd3cd2b019 WatchSource:0}: Error finding container 031047576db4d7747ca909fb5ce64700e27f23cd4a4f1bd542e32ffd3cd2b019: Status 404 returned error can't find the container with id 031047576db4d7747ca909fb5ce64700e27f23cd4a4f1bd542e32ffd3cd2b019 Jul 24 03:46:04.295110 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:04.295072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" event={"ID":"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d","Type":"ContainerStarted","Data":"1981f310404604ac1cc80430677355845972cb445d41bf6dcc04dc991560b5aa"} Jul 24 03:46:04.295590 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:04.295155 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" event={"ID":"5c9845fe-b77d-4c2d-84fc-fed6aae59b0d","Type":"ContainerStarted","Data":"031047576db4d7747ca909fb5ce64700e27f23cd4a4f1bd542e32ffd3cd2b019"} Jul 24 03:46:04.295590 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:04.295189 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:04.324427 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:04.324365 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" podStartSLOduration=2.324349128 podStartE2EDuration="2.324349128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:46:04.322863455 +0000 UTC m=+1667.822366796" watchObservedRunningTime="2026-07-24 03:46:04.324349128 +0000 UTC m=+1667.823852468" Jul 24 03:46:07.097896 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:07.097849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmfpq_d32d592c-d230-4a4a-9fd1-980647cf692e/dns/0.log" Jul 24 03:46:07.116585 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:07.116551 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmfpq_d32d592c-d230-4a4a-9fd1-980647cf692e/kube-rbac-proxy/0.log" Jul 24 03:46:07.249604 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:07.249572 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wpvxt_258bd8cd-2ad8-4772-a488-b25587e7dfe5/dns-node-resolver/0.log" Jul 24 03:46:07.793509 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:07.793458 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d86b496cc-rhvn4_9576d128-6a3e-496f-80be-f23c5de57319/registry/0.log" Jul 24 03:46:07.861789 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:07.861755 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vlcvq_6ae0ae01-14ed-441f-8b5c-398297a5183d/node-ca/0.log" Jul 24 03:46:08.808501 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:08.808476 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd_38f949c8-30af-47c0-9053-342ae8a6d69f/istio-proxy/0.log" Jul 24 03:46:08.935006 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:08.934974 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-ng5mq_81ef12de-6f0a-4909-89f8-6dddf145a627/discovery/0.log" Jul 24 03:46:09.105058 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:09.105027 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-x2hpx_5271a1af-df19-48c8-828b-437329abfb03/payload-pre-processing/0.log" Jul 24 03:46:09.144699 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:09.144657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6vdkb_4a8aa7bd-169b-4bae-a08b-6742cf4750dc/payload-processing/0.log" Jul 24 03:46:09.848186 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:09.848157 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xc7cz_90791e7e-1c44-4ce4-ab9b-89d7f552e444/serve-healthcheck-canary/0.log" Jul 24 03:46:10.311205 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:10.311183 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-g8j4v" Jul 24 03:46:10.437357 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:10.437320 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbrmz_eaa8a88e-64d9-47be-9329-2adcf06f09bc/kube-rbac-proxy/0.log" Jul 24 03:46:10.456780 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:10.456750 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbrmz_eaa8a88e-64d9-47be-9329-2adcf06f09bc/exporter/0.log" Jul 24 03:46:10.477385 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:10.477348 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbrmz_eaa8a88e-64d9-47be-9329-2adcf06f09bc/extractor/0.log" Jul 24 03:46:13.263736 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:13.263694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8485f56769-nbkts_9d7be892-2ed0-452b-b6ab-82cad1f74c0b/manager/0.log" Jul 24 03:46:13.503191 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:13.503159 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75c644cf-rz2xp_33fb4595-ddcd-419d-9cb3-8a538698f6c0/manager/0.log" Jul 24 03:46:13.520742 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:13.520717 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75c644cf-rz2xp_33fb4595-ddcd-419d-9cb3-8a538698f6c0/copy-manifests/0.log" Jul 24 03:46:13.864764 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:13.864725 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd_38f949c8-30af-47c0-9053-342ae8a6d69f/istio-proxy/0.log" Jul 24 03:46:13.943935 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:13.943901 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-ng5mq_81ef12de-6f0a-4909-89f8-6dddf145a627/discovery/0.log" Jul 24 03:46:14.051330 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:14.051274 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-x2hpx_5271a1af-df19-48c8-828b-437329abfb03/payload-pre-processing/0.log" Jul 24 03:46:14.078235 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:14.078205 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6vdkb_4a8aa7bd-169b-4bae-a08b-6742cf4750dc/payload-processing/0.log" Jul 24 03:46:14.779367 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:14.779329 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-df5f88749-fmlqk_f1e6bbd1-1053-436c-bb1a-72c27c8b2af2/manager/0.log" Jul 24 03:46:14.831499 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:14.831463 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5bcg6_4b5f03c4-66bd-442a-8d9f-ffbfbd55235b/openshift-lws-operator/0.log" Jul 24 03:46:15.229514 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:15.229482 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6njpd_38f949c8-30af-47c0-9053-342ae8a6d69f/istio-proxy/0.log" Jul 24 03:46:15.301887 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:15.301851 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-ng5mq_81ef12de-6f0a-4909-89f8-6dddf145a627/discovery/0.log" Jul 24 03:46:15.417403 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:15.417374 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-x2hpx_5271a1af-df19-48c8-828b-437329abfb03/payload-pre-processing/0.log" Jul 24 03:46:15.446169 ip-10-0-134-231 kubenswrapper[2564]: I0724 03:46:15.446136 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6vdkb_4a8aa7bd-169b-4bae-a08b-6742cf4750dc/payload-processing/0.log"