Jul 06 19:06:08.171662 ip-10-0-141-234 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:06:08.652598 ip-10-0-141-234 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:06:08.652598 ip-10-0-141-234 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:06:08.652598 ip-10-0-141-234 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:06:08.652598 ip-10-0-141-234 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:06:08.652598 ip-10-0-141-234 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:06:08.654087 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.653940 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:06:08.659724 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659703 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:08.659724 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659722 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:08.659724 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659729 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659734 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659740 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659746 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659751 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659755 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659759 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659763 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659767 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659772 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659776 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659780 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659784 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659788 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659792 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659796 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659809 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659814 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659818 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:08.659938 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659823 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659829 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659835 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659841 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659846 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659851 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659856 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659861 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659867 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659871 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659876 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659881 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659886 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659891 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659895 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659902 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659908 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659913 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659927 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659932 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:08.660786 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659936 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659940 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659945 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659949 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659953 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659958 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659963 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659967 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659971 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659976 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659981 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659985 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659990 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.659995 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660000 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660004 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660009 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660014 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660018 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660023 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:08.661691 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660027 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660032 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660036 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660041 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660045 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660050 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660055 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660061 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660065 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660070 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660074 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660087 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660092 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660097 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660106 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660112 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660118 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660123 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660128 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:08.662610 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660133 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660138 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660143 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660149 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660153 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660158 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660163 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660168 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660173 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660178 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660182 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660187 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660193 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660197 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660202 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660207 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660212 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660216 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.660221 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661635 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:08.663391 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661646 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661652 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661657 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661663 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661669 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661687 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661694 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661699 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661703 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661707 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661712 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661716 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661720 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661724 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661729 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661734 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661738 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661743 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661747 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:08.664030 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661752 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661756 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661761 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661765 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661770 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661774 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661778 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661784 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661788 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661792 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661797 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661802 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661808 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661813 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661818 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661823 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661828 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661832 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661837 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661843 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:08.664543 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661847 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661852 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661856 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661861 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661865 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661870 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661875 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661879 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661884 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661892 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661899 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661904 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661910 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661915 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661919 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661925 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661930 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661935 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661939 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:08.665067 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661943 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661953 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661958 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661962 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661967 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661972 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661977 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661982 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661986 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661990 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661995 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.661999 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662004 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662010 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662014 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662019 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662023 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662028 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662032 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662037 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:08.665575 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662041 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662045 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662050 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662055 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662059 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662064 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662070 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662074 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662079 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662084 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662088 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662095 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662101 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662107 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662112 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662117 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662121 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662126 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662131 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:08.666066 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.662135 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.664840 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.664882 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.664992 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665001 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665005 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665009 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665012 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665018 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665023 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665027 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665031 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665035 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665038 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665041 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665045 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665047 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665050 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665053 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665056 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:08.666600 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665059 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665062 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665064 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665067 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665070 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665073 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665076 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665079 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665082 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665085 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665088 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665091 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665094 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665099 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665102 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665106 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665109 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665112 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665115 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665118 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:08.667119 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665120 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665123 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665126 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665129 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665131 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665134 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665137 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665140 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665143 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665146 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665149 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665151 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665154 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665157 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665159 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665165 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665170 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665173 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665176 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:08.667695 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665179 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665182 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665186 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665189 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665191 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665195 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665197 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665201 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665204 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665207 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665210 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665213 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665216 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665219 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665222 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665225 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665227 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665230 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665235 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665239 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:08.668176 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665242 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665244 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665247 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665250 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665252 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665255 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665258 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665260 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665263 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665266 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665269 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665272 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665274 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665277 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665280 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665282 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665285 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665288 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665291 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665295 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:08.668731 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.665298 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665395 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665408 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665415 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665420 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665425 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665428 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665433 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665437 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665440 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665444 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665449 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665454 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665459 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665464 2574 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665469 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665473 2574 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665476 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665481 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665487 2574 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665490 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665493 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665496 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665500 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:06:08.669271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665504 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665507 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665511 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665514 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665517 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665520 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665524 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665528 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665531 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665535 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665539 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665542 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665545 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665548 2574 flags.go:64] FLAG: --enable-server="true" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665551 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665556 2574 flags.go:64] FLAG: --event-burst="100" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665559 2574 flags.go:64] FLAG: --event-qps="50" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665562 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665565 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665568 2574 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665573 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665576 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665579 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665583 2574 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665586 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:06:08.670018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665590 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665593 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665597 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665600 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665603 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665607 2574 flags.go:64] FLAG: --feature-gates="" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665611 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665614 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665617 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665620 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665624 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665627 2574 flags.go:64] FLAG: --help="false" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665630 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-141-234.ec2.internal" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665633 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665637 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665640 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665644 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665648 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665651 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665654 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665657 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665660 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665663 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665666 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:06:08.670684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665669 2574 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665672 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665675 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665678 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665681 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665684 2574 flags.go:64] FLAG: --lock-file="" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665687 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665690 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665693 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665699 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665702 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665706 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665709 2574 flags.go:64] FLAG: --logging-format="text" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665712 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665715 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665718 2574 flags.go:64] FLAG: --manifest-url="" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665721 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665726 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665729 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665733 2574 flags.go:64] FLAG: --max-pods="110" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665736 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665739 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665746 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665750 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665753 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:06:08.671300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665756 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665759 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665767 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665771 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665775 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665778 2574 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665781 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665786 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665789 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665793 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665796 2574 flags.go:64] FLAG: --port="10250" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665799 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665802 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01993332a3dbf8e58" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665805 2574 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665808 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665812 2574 flags.go:64] FLAG: --register-node="true" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665815 2574 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665824 2574 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665827 2574 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665831 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665834 2574 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665838 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665841 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665844 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665847 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:06:08.671962 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665850 2574 flags.go:64] FLAG: --runonce="false" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665853 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665856 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665860 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665863 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665867 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665871 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665875 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665878 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665881 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665884 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665887 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665890 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665893 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665896 2574 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665900 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665906 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665910 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665912 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665917 2574 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665920 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665924 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665927 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665930 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665933 2574 flags.go:64] FLAG: --v="2" Jul 06 19:06:08.672639 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665938 2574 flags.go:64] FLAG: --version="false" Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665942 2574 flags.go:64] FLAG: --vmodule="" Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665946 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.665950 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666088 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666094 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666097 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666101 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666104 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666108 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666112 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666115 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666120 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666123 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666126 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666129 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666132 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666135 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666138 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666141 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:08.673335 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666143 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666148 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666151 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666155 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666158 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666161 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666164 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666167 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666170 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666174 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666178 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666181 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666184 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666187 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666190 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666193 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666196 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666199 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666202 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:08.673913 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666204 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666207 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666210 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666214 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666217 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666221 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666224 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666227 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666230 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666232 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666235 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666238 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666241 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666243 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666246 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666249 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666252 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666255 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666257 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:08.674425 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666262 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666265 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666269 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666271 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666274 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666277 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666280 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666283 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666286 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666288 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666292 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666295 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666297 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666300 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666303 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666306 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666310 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666312 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666317 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666319 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:08.674935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666322 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666325 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666328 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666331 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666333 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666336 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666339 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666342 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666344 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666347 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666350 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666353 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666355 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666358 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666361 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666381 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666386 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666390 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666393 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666396 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:08.675537 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666398 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666401 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666404 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666408 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.666411 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.666416 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.673440 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.673458 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.674444 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.674452 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674512 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674517 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674521 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674526 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:08.676047 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674530 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674533 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674536 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674539 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674542 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674546 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674549 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674552 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674554 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674558 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674561 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674564 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674567 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674570 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674573 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674576 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674579 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674582 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674584 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674587 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:08.676430 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674590 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674593 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674595 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674598 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674601 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674605 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674609 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674611 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674614 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674618 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674620 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674623 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674626 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674628 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674631 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674634 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674637 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674639 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674642 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674645 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:08.676951 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674647 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674650 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674653 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674655 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674658 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674661 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674664 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674666 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674669 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674673 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674677 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674680 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674683 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674686 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674689 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674691 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674694 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674698 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674702 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:08.677484 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674704 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674707 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674710 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674713 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674715 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674718 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674721 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674723 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674726 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674730 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674734 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674737 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674740 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674743 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674745 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674748 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674751 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674754 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674756 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:08.677974 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674759 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674762 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674764 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674767 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674769 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674772 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674775 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674778 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674781 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674783 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674786 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674789 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674792 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674795 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674798 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674801 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:08.678473 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674804 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.674809 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674925 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674930 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674933 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674936 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674940 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674943 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674946 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674949 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674953 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674955 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674958 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674961 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674964 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:08.678890 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674966 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674969 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674972 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674974 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674977 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674980 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674982 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674985 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674988 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674991 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674994 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.674996 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675001 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675005 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675008 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675012 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675015 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675018 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675021 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:08.679308 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675024 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675027 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675030 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675032 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675035 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675038 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675040 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675043 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675046 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675049 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675051 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675054 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675057 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675060 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675063 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675067 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675070 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675073 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675075 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675078 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:08.679875 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675080 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675083 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675086 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675089 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675092 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675095 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675097 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675100 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675103 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675106 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675109 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675112 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675114 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675117 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675120 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675122 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675125 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675128 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675130 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675133 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:08.680404 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675135 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675138 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675141 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675145 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675148 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675152 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675155 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675157 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675160 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675163 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675165 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675168 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675171 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675174 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675177 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675179 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675182 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675185 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675188 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:08.680935 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675190 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675193 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675196 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675200 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675202 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675205 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675208 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:08.675210 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.675215 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.675323 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.677592 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.679596 2574 server.go:1019] "Starting client certificate rotation" Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.679705 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:06:08.681443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.679759 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:06:08.683326 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.683309 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:06:08.684709 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.684695 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:06:08.698321 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.698302 2574 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:06:08.701806 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.701790 2574 log.go:25] "Validated CRI v1 image API" Jul 06 19:06:08.702670 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.702650 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:06:08.705177 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.705157 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cd2a1068-264c-4509-a50c-820f3cc6a7d6:/dev/nvme0n1p3 d324cbf6-97b4-4906-8aa3-9852720cb93c:/dev/nvme0n1p4] Jul 06 19:06:08.705251 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.705177 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:06:08.712173 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.712059 2574 manager.go:216] Machine: {Timestamp:2026-07-06 19:06:08.710448891 +0000 UTC m=+0.405229547 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100792 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec286139398f670fe50c3f643a8d7978 SystemUUID:ec286139-398f-670f-e50c-3f643a8d7978 BootID:d7caf13f-fd19-4378-b84c-f9752ae7349d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e3:eb:45:51:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e3:eb:45:51:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:8c:ce:ce:31:02 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:06:08.712173 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.712171 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:06:08.712293 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.712253 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:06:08.714730 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.714712 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:06:08.716079 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.716056 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:06:08.716248 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.716083 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:06:08.716800 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.716788 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:06:08.716836 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.716803 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:06:08.716836 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.716811 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:06:08.716836 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.716825 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:06:08.718318 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.718308 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:06:08.722402 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722390 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:06:08.722530 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722520 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:06:08.722568 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722550 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:06:08.722568 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722560 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:06:08.722626 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722575 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:06:08.722626 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722584 2574 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:06:08.722626 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722593 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:06:08.722985 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722972 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:06:08.723035 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.722999 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:06:08.725419 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.725403 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:06:08.728327 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.728314 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:06:08.728400 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.728349 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:06:08.730473 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730459 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:06:08.730517 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730478 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:06:08.730517 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730485 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:06:08.730517 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730490 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:06:08.730517 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730500 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:06:08.730517 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730506 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:06:08.730517 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730515 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:06:08.730517 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730520 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:06:08.730726 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730527 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:06:08.730726 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730533 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:06:08.730726 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730542 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:06:08.730726 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.730549 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:06:08.731297 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.731276 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:06:08.731385 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.731362 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:06:08.731697 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.731686 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:06:08.731697 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.731696 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:06:08.734926 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.734906 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:06:08.734986 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.734951 2574 server.go:1268] "Started kubelet" Jul 06 19:06:08.735136 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.735107 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:06:08.735136 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.735100 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:06:08.735285 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.735165 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:06:08.735828 ip-10-0-141-234 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:06:08.736945 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.736930 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:06:08.738052 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.738039 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:06:08.741443 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.741346 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:06:08.742906 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.741861 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-234.ec2.internal.18bfc8cef9644d25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-234.ec2.internal,UID:ip-10-0-141-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-234.ec2.internal,},FirstTimestamp:2026-07-06 19:06:08.734924069 +0000 UTC m=+0.429704724,LastTimestamp:2026-07-06 19:06:08.734924069 +0000 UTC m=+0.429704724,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-234.ec2.internal,}" Jul 06 19:06:08.744867 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.744850 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kcnqg" Jul 06 19:06:08.745089 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.745074 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:06:08.745154 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.745078 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:06:08.745206 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.745174 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:08.745788 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.745771 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:06:08.745875 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.745772 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:06:08.745875 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.745831 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:06:08.746011 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.745998 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:06:08.746011 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.746011 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:06:08.747164 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.747066 2574 factory.go:153] Registering CRI-O factory Jul 06 19:06:08.747164 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.747081 2574 factory.go:223] Registration of the crio container factory successfully Jul 06 19:06:08.747164 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.747128 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:06:08.747164 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.747136 2574 factory.go:55] Registering systemd factory Jul 06 19:06:08.747164 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.747144 2574 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:06:08.747164 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.747165 2574 factory.go:103] Registering Raw factory Jul 06 19:06:08.747485 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.747177 2574 manager.go:1196] Started watching for new ooms in manager Jul 06 19:06:08.747891 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.747873 2574 manager.go:349] Starting recovery of all containers Jul 06 19:06:08.748137 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.748112 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:06:08.748258 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.748236 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:06:08.750843 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.750816 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kcnqg" Jul 06 19:06:08.759424 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.759407 2574 manager.go:354] Recovery completed Jul 06 19:06:08.763923 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.763814 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:08.766209 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.766192 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:08.766280 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.766221 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:08.766280 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.766232 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:08.766741 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.766727 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:06:08.766805 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.766741 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:06:08.766805 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.766760 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:08.766887 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.766761 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:06:08.767469 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.767452 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:08.767536 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.767482 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:08.767536 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.767493 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:08.768564 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.768550 2574 policy_none.go:49] "None policy: Start" Jul 06 19:06:08.768634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.768569 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:06:08.768634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.768583 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:06:08.769947 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.769933 2574 policy_none.go:47] "Start" Jul 06 19:06:08.809973 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.809955 2574 manager.go:337] "Starting Device Plugin manager" Jul 06 19:06:08.810062 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.810003 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:06:08.810062 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.810017 2574 server.go:87] "Starting device plugin registration server" Jul 06 19:06:08.810275 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.810261 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:06:08.810345 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.810276 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:06:08.810415 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.810345 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:06:08.810472 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.810434 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:06:08.810472 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.810444 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:06:08.810940 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.810921 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:06:08.811009 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.810966 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:08.881480 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.881444 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:06:08.882763 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.882747 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:06:08.882833 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.882798 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:06:08.882833 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.882822 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:06:08.882930 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.882867 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:06:08.885702 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.885675 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:08.911386 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.911327 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:08.912223 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.912205 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:08.912310 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.912237 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:08.912310 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.912252 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:08.912310 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.912276 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-234.ec2.internal" Jul 06 19:06:08.921461 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.921443 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-234.ec2.internal" Jul 06 19:06:08.921568 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.921473 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-234.ec2.internal\": node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:08.935448 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:08.935425 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:08.983960 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.983932 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal"] Jul 06 19:06:08.984068 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.984001 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:08.984877 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.984859 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:08.984964 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.984898 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:08.984964 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.984914 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:08.987541 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.987525 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:08.987687 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.987670 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:08.987735 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.987704 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:08.988244 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.988226 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:08.988358 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.988253 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:08.988358 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.988264 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:08.988358 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.988232 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:08.988358 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.988348 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:08.988488 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.988361 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:08.989712 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.989700 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" Jul 06 19:06:08.989756 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.989725 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:08.990383 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.990363 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:08.990477 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.990398 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:08.990477 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:08.990413 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:09.013157 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.013136 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-234.ec2.internal\" not found" node="ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.017931 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.017914 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-234.ec2.internal\" not found" node="ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.035644 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.035618 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:09.047772 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.047750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a2158bb9c534986551e26d8ba987164-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal\" (UID: \"2a2158bb9c534986551e26d8ba987164\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.047830 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.047780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a2158bb9c534986551e26d8ba987164-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal\" (UID: \"2a2158bb9c534986551e26d8ba987164\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.047830 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.047814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4771f7106329cec29c4726005550184b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-234.ec2.internal\" (UID: \"4771f7106329cec29c4726005550184b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.137388 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.137361 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:09.148574 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.148551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a2158bb9c534986551e26d8ba987164-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal\" (UID: \"2a2158bb9c534986551e26d8ba987164\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.148632 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.148575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a2158bb9c534986551e26d8ba987164-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal\" (UID: \"2a2158bb9c534986551e26d8ba987164\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.148632 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.148590 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a2158bb9c534986551e26d8ba987164-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal\" (UID: \"2a2158bb9c534986551e26d8ba987164\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.148632 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.148625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4771f7106329cec29c4726005550184b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-234.ec2.internal\" (UID: \"4771f7106329cec29c4726005550184b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.148728 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.148663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4771f7106329cec29c4726005550184b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-234.ec2.internal\" (UID: \"4771f7106329cec29c4726005550184b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.148728 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.148693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a2158bb9c534986551e26d8ba987164-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal\" (UID: \"2a2158bb9c534986551e26d8ba987164\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.238601 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.238525 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:09.321369 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.321317 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.321369 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.321369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.339102 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.339080 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:09.443936 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.443900 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:09.544379 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.544302 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:09.644770 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.644742 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-234.ec2.internal\" not found" Jul 06 19:06:09.646421 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.646404 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:09.679253 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.679234 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:06:09.679660 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.679352 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:06:09.679660 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.679356 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:06:09.723426 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.723403 2574 apiserver.go:52] "Watching apiserver" Jul 06 19:06:09.730832 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.730808 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:09.739763 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.739741 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:06:09.740101 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.740081 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-wshwj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z","openshift-cluster-node-tuning-operator/tuned-xj7v8","openshift-dns/node-resolver-f2xlb","openshift-multus/multus-2g8nz","openshift-multus/network-metrics-daemon-chqfs","openshift-network-operator/iptables-alerter-fcwt6","openshift-ovn-kubernetes/ovnkube-node-224lr","kube-system/global-pull-secret-syncer-ph444","kube-system/konnectivity-agent-dft7p","openshift-image-registry/node-ca-s2sfd","openshift-multus/multus-additional-cni-plugins-zxqpl"] Jul 06 19:06:09.742288 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.742271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.743793 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.743771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.744901 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.744879 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2qg8f\"" Jul 06 19:06:09.745041 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.744927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.745149 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.745110 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:06:09.745258 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.745163 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:06:09.745320 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.745255 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.745445 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.745425 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:06:09.745501 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.745463 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:06:09.746074 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.746036 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:06:09.750383 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.749217 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.751494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.750615 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dvdjr\"" Jul 06 19:06:09.751494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.750731 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:06:09.751494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.750747 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:06:09.751494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.750926 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qbwwn\"" Jul 06 19:06:09.751494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.751066 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:06:09.751494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.751263 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:06:09.751494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.751380 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:06:09.752306 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9s2x\" (UniqueName: \"kubernetes.io/projected/3355c83e-68be-4a34-b9b8-6016197dfc05-kube-api-access-s9s2x\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.752416 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.752495 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-sys-fs\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.752572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752511 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fkm4f\"" Jul 06 19:06:09.752572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-kubelet\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.752572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752550 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:06:09.752759 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-conf-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.752759 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-etc-kubernetes\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.752759 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-cni-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.752759 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752747 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-cni-multus\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.752971 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-iptables-alerter-script\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.752971 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752904 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:06:09.752971 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752861 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:01:09 +0000 UTC" deadline="2028-02-03 20:51:21.541016866 +0000 UTC" Jul 06 19:06:09.752971 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752960 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13849h45m11.788065481s" Jul 06 19:06:09.753174 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.752976 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-socket-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.753174 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjbv5\" (UniqueName: \"kubernetes.io/projected/114a3f97-469a-44f1-b181-fd4d01cdf4f0-kube-api-access-tjbv5\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.753174 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-socket-dir-parent\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.753334 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-host-slash\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.753334 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-os-release\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.753334 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-registration-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.753521 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjpfn\" (UniqueName: \"kubernetes.io/projected/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-kube-api-access-xjpfn\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.753521 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3355c83e-68be-4a34-b9b8-6016197dfc05-cni-binary-copy\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.753521 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.753521 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.753477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-cni-bin\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.754439 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzj2l\" (UniqueName: \"kubernetes.io/projected/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-kube-api-access-rzj2l\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.754439 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754341 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/114a3f97-469a-44f1-b181-fd4d01cdf4f0-tmp-dir\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.754439 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754373 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-k8s-cni-cncf-io\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.754439 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-netns\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.754439 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-multus-certs\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.754741 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-daemon-config\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.754741 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-device-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.754741 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/114a3f97-469a-44f1-b181-fd4d01cdf4f0-hosts-file\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.754741 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-system-cni-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.754741 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-cnibin\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.754741 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-hostroot\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.755067 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.754811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.755251 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.755225 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:06:09.756356 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.756327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:09.758173 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.758155 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:09.758250 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.758230 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:09.759942 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.759928 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.760303 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760278 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:06:09.760392 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760377 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:06:09.760452 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760432 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:06:09.760494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760466 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:06:09.760643 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760628 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s7cmv\"" Jul 06 19:06:09.760707 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760694 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:06:09.760766 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760752 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:06:09.760816 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760804 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:06:09.760869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760830 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6kdmq\"" Jul 06 19:06:09.761007 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.760992 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:06:09.761665 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.761652 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:09.761715 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.761702 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:09.762216 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.762200 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:06:09.762376 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.762350 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqxjf\"" Jul 06 19:06:09.762509 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.762495 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:06:09.762986 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.762975 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.763039 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.763023 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:09.763780 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.763763 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:06:09.764675 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.764397 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.764675 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.764511 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:06:09.764675 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.764599 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" Jul 06 19:06:09.766181 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.766164 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal"] Jul 06 19:06:09.766271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.766247 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.766775 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.766757 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:06:09.766775 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.766768 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:06:09.766872 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.766768 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:06:09.766872 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.766802 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2stg7\"" Jul 06 19:06:09.768408 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.768392 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:06:09.768559 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.768524 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:06:09.768681 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.768630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kq4vc\"" Jul 06 19:06:09.774021 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.774000 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal"] Jul 06 19:06:09.774133 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.774118 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:06:09.787822 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.787804 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gm78r" Jul 06 19:06:09.794891 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.794825 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gm78r" Jul 06 19:06:09.847953 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.847928 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:06:09.855544 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-ovn\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.855665 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-cni-netd\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.855665 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-os-release\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.855665 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:09.855665 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-systemd\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.855665 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855654 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-run-netns\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.855877 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-systemd\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.855877 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a91b2b1-8ec6-4889-ac94-bb55e25391f6-agent-certs\") pod \"konnectivity-agent-dft7p\" (UID: \"0a91b2b1-8ec6-4889-ac94-bb55e25391f6\") " pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:09.855877 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-modprobe-d\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.855877 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855791 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:09.855877 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.855877 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855842 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-host\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.855877 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzj2l\" (UniqueName: \"kubernetes.io/projected/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-kube-api-access-rzj2l\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.855992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a91b2b1-8ec6-4889-ac94-bb55e25391f6-konnectivity-ca\") pod \"konnectivity-agent-dft7p\" (UID: \"0a91b2b1-8ec6-4889-ac94-bb55e25391f6\") " pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/114a3f97-469a-44f1-b181-fd4d01cdf4f0-tmp-dir\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-netns\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-log-socket\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856123 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-netns\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-host\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysctl-conf\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.856190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-var-lib-kubelet\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-daemon-config\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-hostroot\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-env-overrides\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk42n\" (UniqueName: \"kubernetes.io/projected/43be5139-6ef1-42e8-90fb-757c0c8dea14-kube-api-access-dk42n\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856330 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/114a3f97-469a-44f1-b181-fd4d01cdf4f0-tmp-dir\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856348 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-serviceca\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-system-cni-dir\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jlpz\" (UniqueName: \"kubernetes.io/projected/40b8351c-7389-4119-a482-1c3d0540468a-kube-api-access-9jlpz\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856446 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5ht\" (UniqueName: \"kubernetes.io/projected/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-kube-api-access-xv5ht\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-cni-multus\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-iptables-alerter-script\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-hostroot\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-slash\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-var-lib-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.856860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-cni-multus\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovnkube-script-lib\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-lib-modules\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-socket-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjbv5\" (UniqueName: \"kubernetes.io/projected/114a3f97-469a-44f1-b181-fd4d01cdf4f0-kube-api-access-tjbv5\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-socket-dir-parent\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-host-slash\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-systemd-units\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-run-ovn-kubernetes\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856838 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-os-release\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-daemon-config\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-socket-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-node-log\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-host-slash\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856981 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-socket-dir-parent\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.856982 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-os-release\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.857782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysconfig\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857033 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysctl-d\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-run\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-registration-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-iptables-alerter-script\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjpfn\" (UniqueName: \"kubernetes.io/projected/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-kube-api-access-xjpfn\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857152 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3355c83e-68be-4a34-b9b8-6016197dfc05-cni-binary-copy\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857171 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-registration-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovn-node-metrics-cert\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-cnibin\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-sys\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-cni-bin\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-tmp\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq6jw\" (UniqueName: \"kubernetes.io/projected/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-kube-api-access-cq6jw\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-kubelet-config\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-cni-bin\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.858602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-k8s-cni-cncf-io\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-multus-certs\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857543 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-k8s-cni-cncf-io\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-cni-bin\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovnkube-config\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857649 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-run-multus-certs\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-tuned\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3355c83e-68be-4a34-b9b8-6016197dfc05-cni-binary-copy\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857712 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-device-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/114a3f97-469a-44f1-b181-fd4d01cdf4f0-hosts-file\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-system-cni-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-cnibin\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9s2x\" (UniqueName: \"kubernetes.io/projected/3355c83e-68be-4a34-b9b8-6016197dfc05-kube-api-access-s9s2x\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-device-dir\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-kubelet\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-system-cni-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857843 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-cnibin\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857849 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/114a3f97-469a-44f1-b181-fd4d01cdf4f0-hosts-file\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.859215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857906 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-sys-fs\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-kubelet\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.857991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-host-var-lib-kubelet\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858064 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-sys-fs\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-conf-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-etc-kubernetes\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-kubernetes\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-conf-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-dbus\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-etc-kubernetes\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-cni-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-etc-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84nh4\" (UniqueName: \"kubernetes.io/projected/b441ae33-94ce-45a0-ad64-c31e021cd02a-kube-api-access-84nh4\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.859978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.858340 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3355c83e-68be-4a34-b9b8-6016197dfc05-multus-cni-dir\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.863326 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.863298 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:06:09.866793 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.866772 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjpfn\" (UniqueName: \"kubernetes.io/projected/7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6-kube-api-access-xjpfn\") pod \"aws-ebs-csi-driver-node-srf2z\" (UID: \"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:09.866888 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.866783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjbv5\" (UniqueName: \"kubernetes.io/projected/114a3f97-469a-44f1-b181-fd4d01cdf4f0-kube-api-access-tjbv5\") pod \"node-resolver-f2xlb\" (UID: \"114a3f97-469a-44f1-b181-fd4d01cdf4f0\") " pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:09.866888 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.866870 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzj2l\" (UniqueName: \"kubernetes.io/projected/2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67-kube-api-access-rzj2l\") pod \"iptables-alerter-fcwt6\" (UID: \"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67\") " pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:09.866961 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.866870 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9s2x\" (UniqueName: \"kubernetes.io/projected/3355c83e-68be-4a34-b9b8-6016197dfc05-kube-api-access-s9s2x\") pod \"multus-2g8nz\" (UID: \"3355c83e-68be-4a34-b9b8-6016197dfc05\") " pod="openshift-multus/multus-2g8nz" Jul 06 19:06:09.912549 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:09.912522 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4771f7106329cec29c4726005550184b.slice/crio-bb665bb1db82fa4d5ace3a42dba80a936bee32f2f6824f0d53c40bd319e54c70 WatchSource:0}: Error finding container bb665bb1db82fa4d5ace3a42dba80a936bee32f2f6824f0d53c40bd319e54c70: Status 404 returned error can't find the container with id bb665bb1db82fa4d5ace3a42dba80a936bee32f2f6824f0d53c40bd319e54c70 Jul 06 19:06:09.913093 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:09.913072 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2158bb9c534986551e26d8ba987164.slice/crio-e08b5a49b86ff40f1494224c30916f27a636beda26e4d1405c1471ff9bb346ea WatchSource:0}: Error finding container e08b5a49b86ff40f1494224c30916f27a636beda26e4d1405c1471ff9bb346ea: Status 404 returned error can't find the container with id e08b5a49b86ff40f1494224c30916f27a636beda26e4d1405c1471ff9bb346ea Jul 06 19:06:09.919777 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.919761 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:06:09.959001 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.958974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-slash\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959001 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-var-lib-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959157 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovnkube-script-lib\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959157 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.959157 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-lib-modules\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959157 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959109 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-slash\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-systemd-units\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-lib-modules\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-run-ovn-kubernetes\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-node-log\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959263 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-var-lib-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysconfig\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysctl-d\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-systemd-units\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959342 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-run\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959368 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovn-node-metrics-cert\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-node-log\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-cnibin\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-run\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959422 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959319 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-run-ovn-kubernetes\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-sys\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysconfig\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysctl-d\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-tmp\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959472 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-cnibin\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq6jw\" (UniqueName: \"kubernetes.io/projected/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-kube-api-access-cq6jw\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-sys\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-kubelet-config\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959613 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959615 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-kubelet-config\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.959809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-cni-bin\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-cni-bin\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovnkube-config\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-tuned\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-kubelet\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-kubelet\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959803 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovnkube-script-lib\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-kubernetes\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-dbus\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-etc-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959929 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-kubernetes\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.959927 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959979 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-etc-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.959988 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-dbus\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84nh4\" (UniqueName: \"kubernetes.io/projected/b441ae33-94ce-45a0-ad64-c31e021cd02a-kube-api-access-84nh4\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-ovn\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-cni-netd\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.960572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-os-release\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.960624 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret podName:137e73ff-87f0-44f7-aa8d-f7673d57fd4e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:10.460135031 +0000 UTC m=+2.154915679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret") pod "global-pull-secret-syncer-ph444" (UID: "137e73ff-87f0-44f7-aa8d-f7673d57fd4e") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-systemd\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960778 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-run-netns\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-systemd\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a91b2b1-8ec6-4889-ac94-bb55e25391f6-agent-certs\") pod \"konnectivity-agent-dft7p\" (UID: \"0a91b2b1-8ec6-4889-ac94-bb55e25391f6\") " pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-modprobe-d\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.960986 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-ovn\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961056 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovnkube-config\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961152 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-host\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-host\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.961300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a91b2b1-8ec6-4889-ac94-bb55e25391f6-konnectivity-ca\") pod \"konnectivity-agent-dft7p\" (UID: \"0a91b2b1-8ec6-4889-ac94-bb55e25391f6\") " pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-log-socket\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-host\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961461 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysctl-conf\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-var-lib-kubelet\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-env-overrides\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961561 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk42n\" (UniqueName: \"kubernetes.io/projected/43be5139-6ef1-42e8-90fb-757c0c8dea14-kube-api-access-dk42n\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-serviceca\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-run-netns\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-system-cni-dir\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jlpz\" (UniqueName: \"kubernetes.io/projected/40b8351c-7389-4119-a482-1c3d0540468a-kube-api-access-9jlpz\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961668 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-systemd\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.962180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.961696 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5ht\" (UniqueName: \"kubernetes.io/projected/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-kube-api-access-xv5ht\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.962869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962358 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.962869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-os-release\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.962869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.962869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-tuned\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.962869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-tmp\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.962869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962777 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/43be5139-6ef1-42e8-90fb-757c0c8dea14-ovn-node-metrics-cert\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.963165 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962909 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b441ae33-94ce-45a0-ad64-c31e021cd02a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.963165 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962984 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-log-socket\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.963165 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b441ae33-94ce-45a0-ad64-c31e021cd02a-system-cni-dir\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.963165 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963015 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/43be5139-6ef1-42e8-90fb-757c0c8dea14-env-overrides\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.963165 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-host\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.963165 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-serviceca\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.963480 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963218 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-systemd\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.963480 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963255 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-sysctl-conf\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.963480 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.962913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.963480 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963329 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-var-lib-kubelet\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.963480 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.963432 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:09.963805 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.963500 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs podName:40b8351c-7389-4119-a482-1c3d0540468a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:10.463469734 +0000 UTC m=+2.158250375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs") pod "network-metrics-daemon-chqfs" (UID: "40b8351c-7389-4119-a482-1c3d0540468a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:09.963805 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-run-openvswitch\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.963805 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963582 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a91b2b1-8ec6-4889-ac94-bb55e25391f6-konnectivity-ca\") pod \"konnectivity-agent-dft7p\" (UID: \"0a91b2b1-8ec6-4889-ac94-bb55e25391f6\") " pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:09.963805 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963607 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-etc-modprobe-d\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.963805 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.963693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/43be5139-6ef1-42e8-90fb-757c0c8dea14-host-cni-netd\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.965878 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.965859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a91b2b1-8ec6-4889-ac94-bb55e25391f6-agent-certs\") pod \"konnectivity-agent-dft7p\" (UID: \"0a91b2b1-8ec6-4889-ac94-bb55e25391f6\") " pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:09.970661 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.970645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq6jw\" (UniqueName: \"kubernetes.io/projected/dd22a018-8ecb-43b2-a5f1-7c5f6539803d-kube-api-access-cq6jw\") pod \"tuned-xj7v8\" (UID: \"dd22a018-8ecb-43b2-a5f1-7c5f6539803d\") " pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:09.974543 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.974525 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:09.974621 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.974548 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:09.974621 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.974562 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vln2k for pod openshift-network-diagnostics/network-check-target-wshwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:09.974703 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:09.974624 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k podName:ec97af13-588c-42d4-90ce-94843b4d9ed6 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:10.4746077 +0000 UTC m=+2.169388359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vln2k" (UniqueName: "kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k") pod "network-check-target-wshwj" (UID: "ec97af13-588c-42d4-90ce-94843b4d9ed6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:09.976482 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.976457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84nh4\" (UniqueName: \"kubernetes.io/projected/b441ae33-94ce-45a0-ad64-c31e021cd02a-kube-api-access-84nh4\") pod \"multus-additional-cni-plugins-zxqpl\" (UID: \"b441ae33-94ce-45a0-ad64-c31e021cd02a\") " pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:09.976571 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.976545 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5ht\" (UniqueName: \"kubernetes.io/projected/fc6d584f-d9b6-4ae6-a8d4-1312645c44ba-kube-api-access-xv5ht\") pod \"node-ca-s2sfd\" (UID: \"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba\") " pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:09.976909 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.976888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk42n\" (UniqueName: \"kubernetes.io/projected/43be5139-6ef1-42e8-90fb-757c0c8dea14-kube-api-access-dk42n\") pod \"ovnkube-node-224lr\" (UID: \"43be5139-6ef1-42e8-90fb-757c0c8dea14\") " pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:09.977423 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:09.977407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jlpz\" (UniqueName: \"kubernetes.io/projected/40b8351c-7389-4119-a482-1c3d0540468a-kube-api-access-9jlpz\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:10.076706 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.076630 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" Jul 06 19:06:10.086070 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.086041 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b94a8fb_a4d7_442d_8f7f_736aa9a88bf6.slice/crio-9294b44176149063a8abe0d9f7ebcafb96e27f2c98b921868394af1931660f9a WatchSource:0}: Error finding container 9294b44176149063a8abe0d9f7ebcafb96e27f2c98b921868394af1931660f9a: Status 404 returned error can't find the container with id 9294b44176149063a8abe0d9f7ebcafb96e27f2c98b921868394af1931660f9a Jul 06 19:06:10.096724 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.096706 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f2xlb" Jul 06 19:06:10.104620 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.104593 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114a3f97_469a_44f1_b181_fd4d01cdf4f0.slice/crio-1eb265dd893dd0741f73a62f90911e0fcd5f8b60ed5e3737d52afc5f9f3e7d3f WatchSource:0}: Error finding container 1eb265dd893dd0741f73a62f90911e0fcd5f8b60ed5e3737d52afc5f9f3e7d3f: Status 404 returned error can't find the container with id 1eb265dd893dd0741f73a62f90911e0fcd5f8b60ed5e3737d52afc5f9f3e7d3f Jul 06 19:06:10.113903 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.113888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2g8nz" Jul 06 19:06:10.120784 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.120761 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3355c83e_68be_4a34_b9b8_6016197dfc05.slice/crio-ee59e774c326feaf06806a698f2a487d1c628fbe84f310cf907ea39327f5e103 WatchSource:0}: Error finding container ee59e774c326feaf06806a698f2a487d1c628fbe84f310cf907ea39327f5e103: Status 404 returned error can't find the container with id ee59e774c326feaf06806a698f2a487d1c628fbe84f310cf907ea39327f5e103 Jul 06 19:06:10.128928 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.128911 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fcwt6" Jul 06 19:06:10.135631 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.135613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:10.135873 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.135854 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2623a852_ab4f_4e4f_a38b_3d0a3a0dcf67.slice/crio-2a0da1354b2eb03482627262b74c14c097cfe85a1168cfb3b19f9842f4aaf993 WatchSource:0}: Error finding container 2a0da1354b2eb03482627262b74c14c097cfe85a1168cfb3b19f9842f4aaf993: Status 404 returned error can't find the container with id 2a0da1354b2eb03482627262b74c14c097cfe85a1168cfb3b19f9842f4aaf993 Jul 06 19:06:10.145202 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.145180 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43be5139_6ef1_42e8_90fb_757c0c8dea14.slice/crio-c65746dfb0c75a6432f283dd40594d4f6a642b21be48a9ab0b5a8a56173fb81e WatchSource:0}: Error finding container c65746dfb0c75a6432f283dd40594d4f6a642b21be48a9ab0b5a8a56173fb81e: Status 404 returned error can't find the container with id c65746dfb0c75a6432f283dd40594d4f6a642b21be48a9ab0b5a8a56173fb81e Jul 06 19:06:10.162380 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.162353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:10.169884 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.169862 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a91b2b1_8ec6_4889_ac94_bb55e25391f6.slice/crio-326a077e7050fe1ae71a665300e1937669e3db800a7fd2707f07fa39872fec22 WatchSource:0}: Error finding container 326a077e7050fe1ae71a665300e1937669e3db800a7fd2707f07fa39872fec22: Status 404 returned error can't find the container with id 326a077e7050fe1ae71a665300e1937669e3db800a7fd2707f07fa39872fec22 Jul 06 19:06:10.178522 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.178504 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" Jul 06 19:06:10.185365 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.185342 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd22a018_8ecb_43b2_a5f1_7c5f6539803d.slice/crio-1bcfc17315a93c07e957229e1ebc92f7962827f605a38a5adb3579976b8fc33f WatchSource:0}: Error finding container 1bcfc17315a93c07e957229e1ebc92f7962827f605a38a5adb3579976b8fc33f: Status 404 returned error can't find the container with id 1bcfc17315a93c07e957229e1ebc92f7962827f605a38a5adb3579976b8fc33f Jul 06 19:06:10.190632 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.190615 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s2sfd" Jul 06 19:06:10.196798 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.196783 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" Jul 06 19:06:10.198485 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.198465 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6d584f_d9b6_4ae6_a8d4_1312645c44ba.slice/crio-cd0b1ce19c6df9ba2746e843e63f2b552f4ebf6d312b20c8acc05240997d8723 WatchSource:0}: Error finding container cd0b1ce19c6df9ba2746e843e63f2b552f4ebf6d312b20c8acc05240997d8723: Status 404 returned error can't find the container with id cd0b1ce19c6df9ba2746e843e63f2b552f4ebf6d312b20c8acc05240997d8723 Jul 06 19:06:10.204030 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.204014 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:10.204289 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:10.204269 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb441ae33_94ce_45a0_ad64_c31e021cd02a.slice/crio-12e8094bad865f33bc0a56b7cee09c029cf94f87dfb7b631b6b0bcead560a855 WatchSource:0}: Error finding container 12e8094bad865f33bc0a56b7cee09c029cf94f87dfb7b631b6b0bcead560a855: Status 404 returned error can't find the container with id 12e8094bad865f33bc0a56b7cee09c029cf94f87dfb7b631b6b0bcead560a855 Jul 06 19:06:10.466318 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.466216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:10.466318 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.466275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:10.466514 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:10.466422 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:10.466514 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:10.466499 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret podName:137e73ff-87f0-44f7-aa8d-f7673d57fd4e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:11.466479484 +0000 UTC m=+3.161260131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret") pod "global-pull-secret-syncer-ph444" (UID: "137e73ff-87f0-44f7-aa8d-f7673d57fd4e") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:10.466626 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:10.466422 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:10.466626 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:10.466595 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs podName:40b8351c-7389-4119-a482-1c3d0540468a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:11.46656809 +0000 UTC m=+3.161348736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs") pod "network-metrics-daemon-chqfs" (UID: "40b8351c-7389-4119-a482-1c3d0540468a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:10.526410 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.526376 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:10.567352 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.567299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:10.567525 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:10.567448 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:10.567525 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:10.567471 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:10.567525 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:10.567484 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vln2k for pod openshift-network-diagnostics/network-check-target-wshwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:10.567703 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:10.567542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k podName:ec97af13-588c-42d4-90ce-94843b4d9ed6 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:11.567523016 +0000 UTC m=+3.262303663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vln2k" (UniqueName: "kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k") pod "network-check-target-wshwj" (UID: "ec97af13-588c-42d4-90ce-94843b4d9ed6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:10.801341 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.801223 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:01:10 +0000 UTC" deadline="2028-01-17 02:47:50.351896722 +0000 UTC" Jul 06 19:06:10.801341 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.801308 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13423h41m39.550593401s" Jul 06 19:06:10.902329 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.902267 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s2sfd" event={"ID":"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba","Type":"ContainerStarted","Data":"cd0b1ce19c6df9ba2746e843e63f2b552f4ebf6d312b20c8acc05240997d8723"} Jul 06 19:06:10.913603 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.913567 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" event={"ID":"dd22a018-8ecb-43b2-a5f1-7c5f6539803d","Type":"ContainerStarted","Data":"1bcfc17315a93c07e957229e1ebc92f7962827f605a38a5adb3579976b8fc33f"} Jul 06 19:06:10.917899 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.917846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dft7p" event={"ID":"0a91b2b1-8ec6-4889-ac94-bb55e25391f6","Type":"ContainerStarted","Data":"326a077e7050fe1ae71a665300e1937669e3db800a7fd2707f07fa39872fec22"} Jul 06 19:06:10.938208 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.938173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2g8nz" event={"ID":"3355c83e-68be-4a34-b9b8-6016197dfc05","Type":"ContainerStarted","Data":"ee59e774c326feaf06806a698f2a487d1c628fbe84f310cf907ea39327f5e103"} Jul 06 19:06:10.947820 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.947790 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f2xlb" event={"ID":"114a3f97-469a-44f1-b181-fd4d01cdf4f0","Type":"ContainerStarted","Data":"1eb265dd893dd0741f73a62f90911e0fcd5f8b60ed5e3737d52afc5f9f3e7d3f"} Jul 06 19:06:10.953415 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.953357 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" event={"ID":"2a2158bb9c534986551e26d8ba987164","Type":"ContainerStarted","Data":"e08b5a49b86ff40f1494224c30916f27a636beda26e4d1405c1471ff9bb346ea"} Jul 06 19:06:10.955612 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.955581 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerStarted","Data":"12e8094bad865f33bc0a56b7cee09c029cf94f87dfb7b631b6b0bcead560a855"} Jul 06 19:06:10.961422 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.961353 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"c65746dfb0c75a6432f283dd40594d4f6a642b21be48a9ab0b5a8a56173fb81e"} Jul 06 19:06:10.980311 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.980268 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fcwt6" event={"ID":"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67","Type":"ContainerStarted","Data":"2a0da1354b2eb03482627262b74c14c097cfe85a1168cfb3b19f9842f4aaf993"} Jul 06 19:06:10.982722 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.982696 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" event={"ID":"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6","Type":"ContainerStarted","Data":"9294b44176149063a8abe0d9f7ebcafb96e27f2c98b921868394af1931660f9a"} Jul 06 19:06:10.984874 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:10.984842 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" event={"ID":"4771f7106329cec29c4726005550184b","Type":"ContainerStarted","Data":"bb665bb1db82fa4d5ace3a42dba80a936bee32f2f6824f0d53c40bd319e54c70"} Jul 06 19:06:11.451160 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.451091 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:11.473403 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.472979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:11.473403 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.473045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:11.473403 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.473214 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:11.473403 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.473277 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs podName:40b8351c-7389-4119-a482-1c3d0540468a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:13.473256807 +0000 UTC m=+5.168037449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs") pod "network-metrics-daemon-chqfs" (UID: "40b8351c-7389-4119-a482-1c3d0540468a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:11.473758 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.473729 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:11.473817 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.473784 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret podName:137e73ff-87f0-44f7-aa8d-f7673d57fd4e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:13.473765639 +0000 UTC m=+5.168546283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret") pod "global-pull-secret-syncer-ph444" (UID: "137e73ff-87f0-44f7-aa8d-f7673d57fd4e") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:11.574206 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.574169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:11.574419 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.574393 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:11.574419 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.574418 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:11.574538 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.574432 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vln2k for pod openshift-network-diagnostics/network-check-target-wshwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:11.574538 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.574504 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k podName:ec97af13-588c-42d4-90ce-94843b4d9ed6 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:13.574485878 +0000 UTC m=+5.269266531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vln2k" (UniqueName: "kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k") pod "network-check-target-wshwj" (UID: "ec97af13-588c-42d4-90ce-94843b4d9ed6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:11.802587 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.802459 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:01:10 +0000 UTC" deadline="2028-03-18 10:26:46.092046206 +0000 UTC" Jul 06 19:06:11.802587 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.802526 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14895h20m34.28952408s" Jul 06 19:06:11.883105 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.883069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:11.883320 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.883213 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:11.884027 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.883699 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:11.884027 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.883800 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:11.884027 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:11.883867 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:11.884027 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:11.883957 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:13.493035 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:13.492998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:13.493558 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:13.493079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:13.493558 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.493150 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:13.493558 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.493238 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret podName:137e73ff-87f0-44f7-aa8d-f7673d57fd4e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:17.493215727 +0000 UTC m=+9.187996366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret") pod "global-pull-secret-syncer-ph444" (UID: "137e73ff-87f0-44f7-aa8d-f7673d57fd4e") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:13.493558 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.493246 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:13.493558 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.493331 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs podName:40b8351c-7389-4119-a482-1c3d0540468a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:17.493312009 +0000 UTC m=+9.188092666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs") pod "network-metrics-daemon-chqfs" (UID: "40b8351c-7389-4119-a482-1c3d0540468a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:13.593768 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:13.593731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:13.593989 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.593969 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:13.594055 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.593997 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:13.594055 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.594010 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vln2k for pod openshift-network-diagnostics/network-check-target-wshwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:13.594166 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.594071 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k podName:ec97af13-588c-42d4-90ce-94843b4d9ed6 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:17.594052725 +0000 UTC m=+9.288833369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vln2k" (UniqueName: "kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k") pod "network-check-target-wshwj" (UID: "ec97af13-588c-42d4-90ce-94843b4d9ed6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:13.883519 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:13.883429 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:13.883676 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.883555 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:13.883964 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:13.883946 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:13.884088 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.884060 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:13.884173 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:13.884110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:13.884231 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:13.884184 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:15.883451 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:15.883412 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:15.883939 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:15.883558 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:15.884028 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:15.883949 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:15.884089 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:15.884037 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:15.884089 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:15.884085 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:15.884206 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:15.884169 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:17.527986 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:17.527942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:17.528457 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:17.528017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:17.528457 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.528179 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:17.528457 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.528246 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs podName:40b8351c-7389-4119-a482-1c3d0540468a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:25.528224715 +0000 UTC m=+17.223005383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs") pod "network-metrics-daemon-chqfs" (UID: "40b8351c-7389-4119-a482-1c3d0540468a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:17.528457 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.528435 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:17.528705 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.528494 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret podName:137e73ff-87f0-44f7-aa8d-f7673d57fd4e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:25.52847793 +0000 UTC m=+17.223258575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret") pod "global-pull-secret-syncer-ph444" (UID: "137e73ff-87f0-44f7-aa8d-f7673d57fd4e") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:17.628717 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:17.628668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:17.628924 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.628843 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:17.628924 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.628868 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:17.628924 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.628884 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vln2k for pod openshift-network-diagnostics/network-check-target-wshwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:17.629109 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.628954 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k podName:ec97af13-588c-42d4-90ce-94843b4d9ed6 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:25.628933453 +0000 UTC m=+17.323714120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vln2k" (UniqueName: "kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k") pod "network-check-target-wshwj" (UID: "ec97af13-588c-42d4-90ce-94843b4d9ed6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:17.883615 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:17.883524 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:17.883773 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.883702 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:17.883849 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:17.883807 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:17.883953 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.883927 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:17.884033 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:17.884017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:17.884160 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:17.884124 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:19.884210 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:19.884125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:19.884668 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:19.884264 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:19.884668 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:19.884132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:19.884668 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:19.884382 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:19.884668 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:19.884132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:19.884668 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:19.884547 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:21.883617 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:21.883585 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:21.884006 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:21.883632 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:21.884006 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:21.883632 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:21.884006 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:21.883713 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:21.884006 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:21.883801 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:21.884006 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:21.883897 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:23.883203 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:23.883164 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:23.883662 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:23.883302 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:23.883662 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:23.883315 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:23.883662 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:23.883342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:23.883662 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:23.883444 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:23.883662 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:23.883514 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:25.592801 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:25.592766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:25.593277 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:25.592816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:25.593277 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.592921 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:25.593277 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.592929 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:25.593277 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.592990 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret podName:137e73ff-87f0-44f7-aa8d-f7673d57fd4e nodeName:}" failed. No retries permitted until 2026-07-06 19:06:41.592973731 +0000 UTC m=+33.287754370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret") pod "global-pull-secret-syncer-ph444" (UID: "137e73ff-87f0-44f7-aa8d-f7673d57fd4e") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:25.593277 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.593036 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs podName:40b8351c-7389-4119-a482-1c3d0540468a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:41.59301496 +0000 UTC m=+33.287795618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs") pod "network-metrics-daemon-chqfs" (UID: "40b8351c-7389-4119-a482-1c3d0540468a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:25.693712 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:25.693662 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:25.693887 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.693852 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:25.693887 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.693878 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:25.693993 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.693892 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vln2k for pod openshift-network-diagnostics/network-check-target-wshwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:25.693993 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.693960 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k podName:ec97af13-588c-42d4-90ce-94843b4d9ed6 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:41.693942001 +0000 UTC m=+33.388722644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vln2k" (UniqueName: "kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k") pod "network-check-target-wshwj" (UID: "ec97af13-588c-42d4-90ce-94843b4d9ed6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:25.884072 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:25.883995 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:25.884260 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:25.884108 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:25.884260 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.884121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:25.884260 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:25.884137 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:25.884260 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.884205 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:25.884476 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:25.884283 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:27.883851 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:27.883595 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:27.884357 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:27.883604 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:27.884357 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:27.883948 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:27.884357 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:27.883604 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:27.884357 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:27.884059 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:27.884357 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:27.884206 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:29.883406 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:29.883376 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:29.883869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:29.883383 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:29.883869 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:29.883507 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:29.883869 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:29.883614 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:29.883869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:29.883384 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:29.883869 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:29.883709 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:31.044710 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.044535 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:06:31.045184 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.045096 2574 generic.go:356] "Generic (PLEG): container finished" podID="43be5139-6ef1-42e8-90fb-757c0c8dea14" containerID="9c8cab527aad488ce8fd4c57b32254d97c008a3c87d9d742abe3555b1abd665b" exitCode=1 Jul 06 19:06:31.045246 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.045179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"540753ae5e3d0920d5098878e5504817f3da68847014d884067728df18e99af5"} Jul 06 19:06:31.045362 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.045262 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"850e4a2f738290ce89bf9dfbf3f6b536f1eeb9d6b0485cbe1b62f8312301a019"} Jul 06 19:06:31.045362 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.045332 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"4d077f2f378f97a8691584c3300a9601c30d0f55e3aff9e38323c3709c461f2d"} Jul 06 19:06:31.045475 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.045382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerDied","Data":"9c8cab527aad488ce8fd4c57b32254d97c008a3c87d9d742abe3555b1abd665b"} Jul 06 19:06:31.045475 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.045433 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"62ac5af5b306fafd0b5b19748758f9e35b3e3bed435fe26ecd3c217c3839f03d"} Jul 06 19:06:31.048707 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.048686 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" event={"ID":"4771f7106329cec29c4726005550184b","Type":"ContainerStarted","Data":"0fb58c4057e394d74987f21a414ceff0093b3f629ea93da728102a9d8661e967"} Jul 06 19:06:31.052765 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.052743 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" event={"ID":"dd22a018-8ecb-43b2-a5f1-7c5f6539803d","Type":"ContainerStarted","Data":"d4c4f22df91c4cec89bb8372db6bb5810c1754214c517c1ec269ae4b91c031a5"} Jul 06 19:06:31.054832 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.054813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2g8nz" event={"ID":"3355c83e-68be-4a34-b9b8-6016197dfc05","Type":"ContainerStarted","Data":"75e1bc94bb1736c8eecff45853f6bc48901ca08450e294af55213b54ce81dc12"} Jul 06 19:06:31.064408 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.064366 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-234.ec2.internal" podStartSLOduration=21.064352953 podStartE2EDuration="21.064352953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:31.063777516 +0000 UTC m=+22.758558178" watchObservedRunningTime="2026-07-06 19:06:31.064352953 +0000 UTC m=+22.759133613" Jul 06 19:06:31.099034 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.098989 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xj7v8" podStartSLOduration=1.069950203 podStartE2EDuration="21.098973319s" totalImagesPullingTime="20.029023116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:31.081989144 +0000 UTC m=+22.776769807" watchObservedRunningTime="2026-07-06 19:06:31.098973319 +0000 UTC m=+22.793753980" Jul 06 19:06:31.099205 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.099114 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2g8nz" podStartSLOduration=1.946347989 podStartE2EDuration="22.099107527s" totalImagesPullingTime="20.152759538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:31.098822734 +0000 UTC m=+22.793603419" watchObservedRunningTime="2026-07-06 19:06:31.099107527 +0000 UTC m=+22.793888187" Jul 06 19:06:31.883512 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.883261 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:31.883643 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.883318 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:31.883643 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:31.883550 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:31.883643 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:31.883324 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:31.883643 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:31.883635 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:31.883827 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:31.883740 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:32.058359 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.058319 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s2sfd" event={"ID":"fc6d584f-d9b6-4ae6-a8d4-1312645c44ba","Type":"ContainerStarted","Data":"a9744142c079566c4192065bfc73854beea112f090d61a2b75a2a617b4323c38"} Jul 06 19:06:32.059716 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.059694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dft7p" event={"ID":"0a91b2b1-8ec6-4889-ac94-bb55e25391f6","Type":"ContainerStarted","Data":"1c68ba7a8b301da48b88f0444cba991c127b02a67f5948f865c40e72818c2f85"} Jul 06 19:06:32.061009 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.060987 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f2xlb" event={"ID":"114a3f97-469a-44f1-b181-fd4d01cdf4f0","Type":"ContainerStarted","Data":"9ae99201739482635b9d9b380a8490d4c2b5bd65538089ad1353117639c94a7e"} Jul 06 19:06:32.062330 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.062309 2574 generic.go:356] "Generic (PLEG): container finished" podID="2a2158bb9c534986551e26d8ba987164" containerID="0709d6f73cb9d05511220ce242ab09d553b19c085786837bfb448c830b5efe5b" exitCode=0 Jul 06 19:06:32.062420 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.062372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" event={"ID":"2a2158bb9c534986551e26d8ba987164","Type":"ContainerDied","Data":"0709d6f73cb9d05511220ce242ab09d553b19c085786837bfb448c830b5efe5b"} Jul 06 19:06:32.063615 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.063596 2574 generic.go:356] "Generic (PLEG): container finished" podID="b441ae33-94ce-45a0-ad64-c31e021cd02a" containerID="31fb0dac112faab23ae144655f8f73b16369499167d7d84b1ab34854019f24dd" exitCode=0 Jul 06 19:06:32.063691 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.063665 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerDied","Data":"31fb0dac112faab23ae144655f8f73b16369499167d7d84b1ab34854019f24dd"} Jul 06 19:06:32.066352 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.066339 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:06:32.066695 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.066675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"f45b24d61e2ebe7e58f5a35b563170f8be5f987af10b1b0e3a10ea51eacabf1a"} Jul 06 19:06:32.068012 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.067992 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fcwt6" event={"ID":"2623a852-ab4f-4e4f-a38b-3d0a3a0dcf67","Type":"ContainerStarted","Data":"4077f0c7f1f9e502508187c2c26cf9d66179a30efad8132ed0f4cb0f8e2dc96b"} Jul 06 19:06:32.069270 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.069247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" event={"ID":"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6","Type":"ContainerStarted","Data":"15b5020e2bb38b502d1588c2b542db4b48567dda540e04b6be78243f0e3d101c"} Jul 06 19:06:32.073279 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.073245 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s2sfd" podStartSLOduration=2.062531499 podStartE2EDuration="22.073233169s" totalImagesPullingTime="20.01070167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:32.0728725 +0000 UTC m=+23.767653163" watchObservedRunningTime="2026-07-06 19:06:32.073233169 +0000 UTC m=+23.768013847" Jul 06 19:06:32.086598 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.086567 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fcwt6" podStartSLOduration=3.01221947 podStartE2EDuration="23.086555721s" totalImagesPullingTime="20.074336251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:32.086500788 +0000 UTC m=+23.781281449" watchObservedRunningTime="2026-07-06 19:06:32.086555721 +0000 UTC m=+23.781336381" Jul 06 19:06:32.103176 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.103140 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dft7p" podStartSLOduration=11.113798719 podStartE2EDuration="23.103128075s" totalImagesPullingTime="11.989329356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:32.102727154 +0000 UTC m=+23.797507811" watchObservedRunningTime="2026-07-06 19:06:32.103128075 +0000 UTC m=+23.797908736" Jul 06 19:06:32.117147 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.117106 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f2xlb" podStartSLOduration=3.036494816 podStartE2EDuration="23.117095188s" totalImagesPullingTime="20.080600372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:32.116717027 +0000 UTC m=+23.811497689" watchObservedRunningTime="2026-07-06 19:06:32.117095188 +0000 UTC m=+23.811875849" Jul 06 19:06:32.236282 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.236202 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:32.359495 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.359468 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:32.459903 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.459872 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:32.561381 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.561260 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:32.826754 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.826673 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:32.915647 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:32.915606 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:33.025041 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.025002 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:33.087638 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.087597 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:33.502748 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.502725 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:06:33.637454 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.637369 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:33.826350 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.826250 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:06:33.502742891Z","UUID":"95ffcaa1-a002-486c-98eb-a8a16f3d8af2","Handler":null,"Name":"","Endpoint":""} Jul 06 19:06:33.827640 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.827624 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:06:33.827742 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.827659 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:06:33.836032 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.836004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:33.883865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.883836 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:33.884053 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.883836 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:33.884053 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:33.883953 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:33.884053 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:33.884011 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:33.884053 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.883844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:33.884250 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:33.884086 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:33.971823 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:33.971743 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:34.073505 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.073457 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:34.076945 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.076913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" event={"ID":"2a2158bb9c534986551e26d8ba987164","Type":"ContainerStarted","Data":"20afa712e72053a1febe9b01749fce2f120a97a69e479d653299d6faddad9a01"} Jul 06 19:06:34.080869 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.080696 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:06:34.081316 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.081180 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"44ea46a086c3c370d6067ba71702d0cf4162ec89cc2ae48d2d77f9406d883d2a"} Jul 06 19:06:34.083180 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.083151 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" event={"ID":"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6","Type":"ContainerStarted","Data":"71f0ce8dae5926faa49bb94a62cfd8cf06e2735dc80a2b339118f8afd9e11c75"} Jul 06 19:06:34.096185 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.096142 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-234.ec2.internal" podStartSLOduration=24.09612654 podStartE2EDuration="24.09612654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:34.095443284 +0000 UTC m=+25.790223945" watchObservedRunningTime="2026-07-06 19:06:34.09612654 +0000 UTC m=+25.790907202" Jul 06 19:06:34.133261 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.133226 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:34.690820 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.690799 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:34.691393 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:34.691371 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:35.087647 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:35.087407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" event={"ID":"7b94a8fb-a4d7-442d-8f7f-736aa9a88bf6","Type":"ContainerStarted","Data":"9ed0672dfe3159b8d0f83aa94b538ae4dfbeaf5aa5c85a0bf3603a7b6324923c"} Jul 06 19:06:35.087814 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:35.087748 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:35.088061 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:35.088046 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dft7p" Jul 06 19:06:35.106057 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:35.106010 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srf2z" podStartSLOduration=3.078427539 podStartE2EDuration="26.105995941s" totalImagesPullingTime="23.027568402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:35.105451142 +0000 UTC m=+26.800231803" watchObservedRunningTime="2026-07-06 19:06:35.105995941 +0000 UTC m=+26.800776605" Jul 06 19:06:35.883106 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:35.883028 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:35.883233 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:35.883123 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:35.883233 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:35.883129 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:35.883233 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:35.883214 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:35.883233 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:35.883130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:35.883382 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:35.883304 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:36.092959 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:36.092930 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:06:36.093301 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:36.093258 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"96a43c202e0b92c626e4d46f764b7ba11cbf2d0cf7d9d4f9388f91788ce8ba58"} Jul 06 19:06:36.093847 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:36.093829 2574 scope.go:117] "RemoveContainer" containerID="9c8cab527aad488ce8fd4c57b32254d97c008a3c87d9d742abe3555b1abd665b" Jul 06 19:06:37.099061 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.098835 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:06:37.099790 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.099434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" event={"ID":"43be5139-6ef1-42e8-90fb-757c0c8dea14","Type":"ContainerStarted","Data":"72dcd737d25500d2015dc3b278ef574db10960341a9abff05a0dc3354994ddd6"} Jul 06 19:06:37.099790 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.099580 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:37.099790 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.099637 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:37.099790 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.099681 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:37.113843 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.113816 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:37.114018 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.114003 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:06:37.127591 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.127552 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" podStartSLOduration=7.997647179 podStartE2EDuration="28.127539357s" totalImagesPullingTime="20.129892178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:37.1265412 +0000 UTC m=+28.821321872" watchObservedRunningTime="2026-07-06 19:06:37.127539357 +0000 UTC m=+28.822320018" Jul 06 19:06:37.883873 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.883834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:37.884071 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.883834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:37.884071 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:37.883960 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:37.884071 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:37.884018 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:37.884071 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:37.883842 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:37.884215 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:37.884121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:39.885309 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:39.884896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:39.885309 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:39.885029 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:39.885856 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:39.885460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:39.885856 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:39.885547 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:39.885856 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:39.885602 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:39.885856 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:39.885676 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:40.641700 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:40.641664 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wshwj"] Jul 06 19:06:40.641862 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:40.641769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:40.641939 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:40.641862 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:40.644857 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:40.644826 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chqfs"] Jul 06 19:06:40.644998 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:40.644937 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:40.645072 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:40.645044 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:40.645672 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:40.645650 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ph444"] Jul 06 19:06:40.645773 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:40.645740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:40.645859 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:40.645836 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:41.113789 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:41.113752 2574 generic.go:356] "Generic (PLEG): container finished" podID="b441ae33-94ce-45a0-ad64-c31e021cd02a" containerID="d70d546bd8ea60500be50452efb159624144b32d246946e1ad0a99f7a0a81ec0" exitCode=0 Jul 06 19:06:41.114159 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:41.113831 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerDied","Data":"d70d546bd8ea60500be50452efb159624144b32d246946e1ad0a99f7a0a81ec0"} Jul 06 19:06:41.614407 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:41.614376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:41.614547 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:41.614431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:41.614547 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:41.614534 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:41.614608 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:41.614584 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret podName:137e73ff-87f0-44f7-aa8d-f7673d57fd4e nodeName:}" failed. No retries permitted until 2026-07-06 19:07:13.614571999 +0000 UTC m=+65.309352638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret") pod "global-pull-secret-syncer-ph444" (UID: "137e73ff-87f0-44f7-aa8d-f7673d57fd4e") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:41.614656 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:41.614534 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:41.614704 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:41.614662 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs podName:40b8351c-7389-4119-a482-1c3d0540468a nodeName:}" failed. No retries permitted until 2026-07-06 19:07:13.61464729 +0000 UTC m=+65.309427929 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs") pod "network-metrics-daemon-chqfs" (UID: "40b8351c-7389-4119-a482-1c3d0540468a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:41.715719 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:41.715689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:41.715863 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:41.715820 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:41.715863 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:41.715835 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:41.715863 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:41.715844 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vln2k for pod openshift-network-diagnostics/network-check-target-wshwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:41.715979 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:41.715901 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k podName:ec97af13-588c-42d4-90ce-94843b4d9ed6 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:13.715882046 +0000 UTC m=+65.410662689 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vln2k" (UniqueName: "kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k") pod "network-check-target-wshwj" (UID: "ec97af13-588c-42d4-90ce-94843b4d9ed6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:42.118031 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:42.117785 2574 generic.go:356] "Generic (PLEG): container finished" podID="b441ae33-94ce-45a0-ad64-c31e021cd02a" containerID="a8413b5bae1c36ef2f02c9a13692e58ea722c77a2bfca89cc8835f9c8de30182" exitCode=0 Jul 06 19:06:42.118031 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:42.117857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerDied","Data":"a8413b5bae1c36ef2f02c9a13692e58ea722c77a2bfca89cc8835f9c8de30182"} Jul 06 19:06:42.883476 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:42.883444 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:42.883476 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:42.883461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:42.883476 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:42.883444 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:42.883750 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:42.883585 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chqfs" podUID="40b8351c-7389-4119-a482-1c3d0540468a" Jul 06 19:06:42.883935 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:42.883904 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wshwj" podUID="ec97af13-588c-42d4-90ce-94843b4d9ed6" Jul 06 19:06:42.884046 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:06:42.884003 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ph444" podUID="137e73ff-87f0-44f7-aa8d-f7673d57fd4e" Jul 06 19:06:43.124806 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:43.124774 2574 generic.go:356] "Generic (PLEG): container finished" podID="b441ae33-94ce-45a0-ad64-c31e021cd02a" containerID="7b891b8c0dfba2ebe7bc45b0b0647e1f2fbbe70ff1b13aa48b20b2cbf3275023" exitCode=0 Jul 06 19:06:43.125124 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:43.124860 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerDied","Data":"7b891b8c0dfba2ebe7bc45b0b0647e1f2fbbe70ff1b13aa48b20b2cbf3275023"} Jul 06 19:06:44.404621 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.404535 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-234.ec2.internal" event="NodeReady" Jul 06 19:06:44.405006 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.404688 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:06:44.437621 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.437588 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c8fc68c48-jqflb"] Jul 06 19:06:44.449561 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.449532 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kfdsp"] Jul 06 19:06:44.449709 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.449628 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.453445 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.453085 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 19:06:44.453445 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.453088 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 19:06:44.453445 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.453141 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5j9kh\"" Jul 06 19:06:44.453445 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.453145 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 19:06:44.458458 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.458435 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 19:06:44.460248 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.460227 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jcvmg"] Jul 06 19:06:44.460355 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.460344 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.462819 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.462798 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:06:44.463397 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.463124 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8npzr\"" Jul 06 19:06:44.463397 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.463194 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:06:44.476250 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.476227 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c8fc68c48-jqflb"] Jul 06 19:06:44.476397 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.476267 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kfdsp"] Jul 06 19:06:44.476397 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.476311 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jcvmg"] Jul 06 19:06:44.476397 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.476388 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jcvmg" Jul 06 19:06:44.478771 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.478753 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:06:44.478892 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.478873 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ll82v\"" Jul 06 19:06:44.478977 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.478778 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:06:44.479057 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.478778 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:06:44.537264 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-bound-sa-token\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.537446 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc5f164e-8559-4875-8e79-7cc2b80d61ab-image-registry-private-configuration\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.537446 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/259905ca-41bf-468b-a876-e86071d1dbb3-tmp-dir\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.537446 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-registry-tls\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.537574 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc5f164e-8559-4875-8e79-7cc2b80d61ab-ca-trust-extracted\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.537574 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc5f164e-8559-4875-8e79-7cc2b80d61ab-installation-pull-secrets\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.537574 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wm8\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-kube-api-access-n5wm8\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.537574 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncrhf\" (UniqueName: \"kubernetes.io/projected/259905ca-41bf-468b-a876-e86071d1dbb3-kube-api-access-ncrhf\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.537710 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/259905ca-41bf-468b-a876-e86071d1dbb3-config-volume\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.537710 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc5f164e-8559-4875-8e79-7cc2b80d61ab-trusted-ca\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.537710 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc5f164e-8559-4875-8e79-7cc2b80d61ab-registry-certificates\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.537710 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.537668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259905ca-41bf-468b-a876-e86071d1dbb3-metrics-tls\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.550215 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.550184 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hdzmv"] Jul 06 19:06:44.561596 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.561569 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.562573 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.562552 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hdzmv"] Jul 06 19:06:44.564046 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.563897 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:06:44.564046 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.563911 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:06:44.564046 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.563905 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:06:44.564046 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.563927 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-29q45\"" Jul 06 19:06:44.564308 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.564058 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:06:44.638234 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-bound-sa-token\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.638421 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638243 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-data-volume\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.638421 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.638421 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638282 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whf97\" (UniqueName: \"kubernetes.io/projected/3f60d132-8e4b-4ebc-b39b-f648b57ba6de-kube-api-access-whf97\") pod \"ingress-canary-jcvmg\" (UID: \"3f60d132-8e4b-4ebc-b39b-f648b57ba6de\") " pod="openshift-ingress-canary/ingress-canary-jcvmg" Jul 06 19:06:44.638421 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc5f164e-8559-4875-8e79-7cc2b80d61ab-image-registry-private-configuration\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.638657 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/259905ca-41bf-468b-a876-e86071d1dbb3-tmp-dir\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.638657 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-registry-tls\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.638657 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc5f164e-8559-4875-8e79-7cc2b80d61ab-ca-trust-extracted\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.638657 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc5f164e-8559-4875-8e79-7cc2b80d61ab-installation-pull-secrets\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.638657 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5wm8\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-kube-api-access-n5wm8\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-824xh\" (UniqueName: \"kubernetes.io/projected/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-kube-api-access-824xh\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncrhf\" (UniqueName: \"kubernetes.io/projected/259905ca-41bf-468b-a876-e86071d1dbb3-kube-api-access-ncrhf\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/259905ca-41bf-468b-a876-e86071d1dbb3-config-volume\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f60d132-8e4b-4ebc-b39b-f648b57ba6de-cert\") pod \"ingress-canary-jcvmg\" (UID: \"3f60d132-8e4b-4ebc-b39b-f648b57ba6de\") " pod="openshift-ingress-canary/ingress-canary-jcvmg" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638764 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/259905ca-41bf-468b-a876-e86071d1dbb3-tmp-dir\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-crio-socket\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc5f164e-8559-4875-8e79-7cc2b80d61ab-trusted-ca\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc5f164e-8559-4875-8e79-7cc2b80d61ab-registry-certificates\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259905ca-41bf-468b-a876-e86071d1dbb3-metrics-tls\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.638898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc5f164e-8559-4875-8e79-7cc2b80d61ab-ca-trust-extracted\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.639413 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.638896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.639538 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.639518 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/259905ca-41bf-468b-a876-e86071d1dbb3-config-volume\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.639786 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.639697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc5f164e-8559-4875-8e79-7cc2b80d61ab-registry-certificates\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.639984 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.639962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc5f164e-8559-4875-8e79-7cc2b80d61ab-trusted-ca\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.642554 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.642529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259905ca-41bf-468b-a876-e86071d1dbb3-metrics-tls\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.642643 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.642559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc5f164e-8559-4875-8e79-7cc2b80d61ab-installation-pull-secrets\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.642643 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.642574 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-registry-tls\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.642715 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.642654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc5f164e-8559-4875-8e79-7cc2b80d61ab-image-registry-private-configuration\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.650630 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.650604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-bound-sa-token\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.650916 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.650897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncrhf\" (UniqueName: \"kubernetes.io/projected/259905ca-41bf-468b-a876-e86071d1dbb3-kube-api-access-ncrhf\") pod \"dns-default-kfdsp\" (UID: \"259905ca-41bf-468b-a876-e86071d1dbb3\") " pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.651017 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.650996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5wm8\" (UniqueName: \"kubernetes.io/projected/cc5f164e-8559-4875-8e79-7cc2b80d61ab-kube-api-access-n5wm8\") pod \"image-registry-c8fc68c48-jqflb\" (UID: \"cc5f164e-8559-4875-8e79-7cc2b80d61ab\") " pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.673425 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.673362 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64bcbbf4bf-rdrlh"] Jul 06 19:06:44.691660 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.691639 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64bcbbf4bf-rdrlh"] Jul 06 19:06:44.691776 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.691740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.694686 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.694335 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:06:44.694686 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.694407 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:06:44.694686 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.694481 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7qvkn\"" Jul 06 19:06:44.694686 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.694519 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:06:44.694686 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.694519 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:06:44.694686 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.694558 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:06:44.695050 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.694869 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:06:44.695050 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.694896 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:06:44.700507 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.700490 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 19:06:44.739944 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.739912 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.740100 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.739967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-data-volume\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.740100 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.739996 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.740100 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.740028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whf97\" (UniqueName: \"kubernetes.io/projected/3f60d132-8e4b-4ebc-b39b-f648b57ba6de-kube-api-access-whf97\") pod \"ingress-canary-jcvmg\" (UID: \"3f60d132-8e4b-4ebc-b39b-f648b57ba6de\") " pod="openshift-ingress-canary/ingress-canary-jcvmg" Jul 06 19:06:44.740263 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.740109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-824xh\" (UniqueName: \"kubernetes.io/projected/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-kube-api-access-824xh\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.740263 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.740141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f60d132-8e4b-4ebc-b39b-f648b57ba6de-cert\") pod \"ingress-canary-jcvmg\" (UID: \"3f60d132-8e4b-4ebc-b39b-f648b57ba6de\") " pod="openshift-ingress-canary/ingress-canary-jcvmg" Jul 06 19:06:44.740263 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.740161 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-crio-socket\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.740472 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.740392 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-crio-socket\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.740472 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.740433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-data-volume\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.740930 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.740908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.742839 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.742795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f60d132-8e4b-4ebc-b39b-f648b57ba6de-cert\") pod \"ingress-canary-jcvmg\" (UID: \"3f60d132-8e4b-4ebc-b39b-f648b57ba6de\") " pod="openshift-ingress-canary/ingress-canary-jcvmg" Jul 06 19:06:44.742926 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.742864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.748338 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.748282 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whf97\" (UniqueName: \"kubernetes.io/projected/3f60d132-8e4b-4ebc-b39b-f648b57ba6de-kube-api-access-whf97\") pod \"ingress-canary-jcvmg\" (UID: \"3f60d132-8e4b-4ebc-b39b-f648b57ba6de\") " pod="openshift-ingress-canary/ingress-canary-jcvmg" Jul 06 19:06:44.748435 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.748353 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-824xh\" (UniqueName: \"kubernetes.io/projected/7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8-kube-api-access-824xh\") pod \"insights-runtime-extractor-hdzmv\" (UID: \"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8\") " pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.761177 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.761155 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:44.771360 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.771337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:44.786140 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.786123 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jcvmg" Jul 06 19:06:44.840861 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.840824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-serving-cert\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.840996 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.840868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-oauth-serving-cert\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.840996 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.840908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x4r5\" (UniqueName: \"kubernetes.io/projected/3cda7abd-16e2-4af4-80f8-858e3466d073-kube-api-access-2x4r5\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.840996 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.840937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-service-ca\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.840996 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.840991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-trusted-ca-bundle\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.841199 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.841065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-console-config\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.841199 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.841131 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-oauth-config\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.870162 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.870128 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hdzmv" Jul 06 19:06:44.884027 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.884002 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:06:44.884184 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.884162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:06:44.884389 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.884359 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:06:44.887031 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.886989 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:06:44.887269 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.887179 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:06:44.887269 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.887216 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xsmh6\"" Jul 06 19:06:44.887269 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.887227 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:06:44.887516 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.887220 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:06:44.887815 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.887769 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-85brg\"" Jul 06 19:06:44.942955 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.942681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-trusted-ca-bundle\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.943075 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.943016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-console-config\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.943075 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.943054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-oauth-config\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.943203 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.943095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-serving-cert\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.943203 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.943127 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-oauth-serving-cert\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.943203 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.943162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x4r5\" (UniqueName: \"kubernetes.io/projected/3cda7abd-16e2-4af4-80f8-858e3466d073-kube-api-access-2x4r5\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.943203 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.943193 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-service-ca\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.944393 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.943841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-trusted-ca-bundle\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.944393 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.944280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-console-config\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.944572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.944407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-oauth-serving-cert\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.944698 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.944674 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-service-ca\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.948465 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.948431 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-serving-cert\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.949940 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.949838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-oauth-config\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.954246 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.954199 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x4r5\" (UniqueName: \"kubernetes.io/projected/3cda7abd-16e2-4af4-80f8-858e3466d073-kube-api-access-2x4r5\") pod \"console-64bcbbf4bf-rdrlh\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:44.990043 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.989954 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kfdsp"] Jul 06 19:06:44.994450 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:44.994336 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259905ca_41bf_468b_a876_e86071d1dbb3.slice/crio-c7584ba995f2df9b7626d9f377dc316a00f7d5d6d7d3d389f8fd6835710446f2 WatchSource:0}: Error finding container c7584ba995f2df9b7626d9f377dc316a00f7d5d6d7d3d389f8fd6835710446f2: Status 404 returned error can't find the container with id c7584ba995f2df9b7626d9f377dc316a00f7d5d6d7d3d389f8fd6835710446f2 Jul 06 19:06:44.995921 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.995792 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c8fc68c48-jqflb"] Jul 06 19:06:44.999955 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:44.999887 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jcvmg"] Jul 06 19:06:45.000581 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:45.000548 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5f164e_8559_4875_8e79_7cc2b80d61ab.slice/crio-10d07da496037a4fecad880b5487f62a73935d9512f288d76f1f1097f7f5f727 WatchSource:0}: Error finding container 10d07da496037a4fecad880b5487f62a73935d9512f288d76f1f1097f7f5f727: Status 404 returned error can't find the container with id 10d07da496037a4fecad880b5487f62a73935d9512f288d76f1f1097f7f5f727 Jul 06 19:06:45.002839 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:45.002820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:06:45.006070 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:45.006032 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f60d132_8e4b_4ebc_b39b_f648b57ba6de.slice/crio-421929a7d37d3f57d84ea355acd0100dc28d297bda66637a2b3cc9f346ba7756 WatchSource:0}: Error finding container 421929a7d37d3f57d84ea355acd0100dc28d297bda66637a2b3cc9f346ba7756: Status 404 returned error can't find the container with id 421929a7d37d3f57d84ea355acd0100dc28d297bda66637a2b3cc9f346ba7756 Jul 06 19:06:45.053148 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:45.053012 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hdzmv"] Jul 06 19:06:45.063536 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:45.063507 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbd9738_bf1b_4278_b5ba_e0f1f4ea8dc8.slice/crio-b80aa1ff2b8e7540af9dcaa671652e198c36d31ff40ab02b918e337916242958 WatchSource:0}: Error finding container b80aa1ff2b8e7540af9dcaa671652e198c36d31ff40ab02b918e337916242958: Status 404 returned error can't find the container with id b80aa1ff2b8e7540af9dcaa671652e198c36d31ff40ab02b918e337916242958 Jul 06 19:06:45.138449 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:45.138413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jcvmg" event={"ID":"3f60d132-8e4b-4ebc-b39b-f648b57ba6de","Type":"ContainerStarted","Data":"421929a7d37d3f57d84ea355acd0100dc28d297bda66637a2b3cc9f346ba7756"} Jul 06 19:06:45.139983 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:45.139956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kfdsp" event={"ID":"259905ca-41bf-468b-a876-e86071d1dbb3","Type":"ContainerStarted","Data":"c7584ba995f2df9b7626d9f377dc316a00f7d5d6d7d3d389f8fd6835710446f2"} Jul 06 19:06:45.141996 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:45.141959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" event={"ID":"cc5f164e-8559-4875-8e79-7cc2b80d61ab","Type":"ContainerStarted","Data":"10d07da496037a4fecad880b5487f62a73935d9512f288d76f1f1097f7f5f727"} Jul 06 19:06:45.143327 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:45.143282 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdzmv" event={"ID":"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8","Type":"ContainerStarted","Data":"b80aa1ff2b8e7540af9dcaa671652e198c36d31ff40ab02b918e337916242958"} Jul 06 19:06:45.180685 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:45.180605 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64bcbbf4bf-rdrlh"] Jul 06 19:06:45.183675 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:06:45.183649 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cda7abd_16e2_4af4_80f8_858e3466d073.slice/crio-14fd433eaef848c6efa2c2c79aeb99a898bb7ce5bf704d6e1d86574dd2dc050f WatchSource:0}: Error finding container 14fd433eaef848c6efa2c2c79aeb99a898bb7ce5bf704d6e1d86574dd2dc050f: Status 404 returned error can't find the container with id 14fd433eaef848c6efa2c2c79aeb99a898bb7ce5bf704d6e1d86574dd2dc050f Jul 06 19:06:46.149912 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:46.149759 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" event={"ID":"cc5f164e-8559-4875-8e79-7cc2b80d61ab","Type":"ContainerStarted","Data":"ecd3e9c127568bd2ffd13c23ff26e1be9c709e69c82ad5319ea21556b9797e71"} Jul 06 19:06:46.149912 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:46.149877 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:06:46.152480 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:46.152425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcbbf4bf-rdrlh" event={"ID":"3cda7abd-16e2-4af4-80f8-858e3466d073","Type":"ContainerStarted","Data":"14fd433eaef848c6efa2c2c79aeb99a898bb7ce5bf704d6e1d86574dd2dc050f"} Jul 06 19:06:46.172572 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:46.171908 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" podStartSLOduration=7.17189019 podStartE2EDuration="7.17189019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:46.170208124 +0000 UTC m=+37.864988786" watchObservedRunningTime="2026-07-06 19:06:46.17189019 +0000 UTC m=+37.866670849" Jul 06 19:06:55.179599 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:55.179352 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jcvmg" event={"ID":"3f60d132-8e4b-4ebc-b39b-f648b57ba6de","Type":"ContainerStarted","Data":"12921712d7bbeaea2d920c79fbe9114eb627a9fabbc8bfd2ace05d738c9c0c5e"} Jul 06 19:06:55.181022 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:55.180897 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcbbf4bf-rdrlh" event={"ID":"3cda7abd-16e2-4af4-80f8-858e3466d073","Type":"ContainerStarted","Data":"e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e"} Jul 06 19:06:55.182257 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:55.182235 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kfdsp" event={"ID":"259905ca-41bf-468b-a876-e86071d1dbb3","Type":"ContainerStarted","Data":"5ba963953ed5e5165d70218250cb138a5c60343086fbc4771052119716286895"} Jul 06 19:06:55.185111 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:55.185088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerStarted","Data":"647d224ef328730888451c4e783013ef7572db7b0ebb1e5b9fc85e94f443efe5"} Jul 06 19:06:55.198486 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:55.198447 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jcvmg" podStartSLOduration=1.373576519 podStartE2EDuration="11.198434272s" totalImagesPullingTime="9.824857753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:55.197794333 +0000 UTC m=+46.892574993" watchObservedRunningTime="2026-07-06 19:06:55.198434272 +0000 UTC m=+46.893214933" Jul 06 19:06:55.244536 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:55.244453 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64bcbbf4bf-rdrlh" podStartSLOduration=1.597973614 podStartE2EDuration="11.244431788s" totalImagesPullingTime="9.646458174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:55.244410438 +0000 UTC m=+46.939191112" watchObservedRunningTime="2026-07-06 19:06:55.244431788 +0000 UTC m=+46.939212450" Jul 06 19:06:56.192433 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:56.192398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kfdsp" event={"ID":"259905ca-41bf-468b-a876-e86071d1dbb3","Type":"ContainerStarted","Data":"fedd8d3854594945e29ba8d647bef43383cd1ff591f191740f9e9a918b35e043"} Jul 06 19:06:56.192841 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:56.192516 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kfdsp" Jul 06 19:06:56.195078 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:56.195054 2574 generic.go:356] "Generic (PLEG): container finished" podID="b441ae33-94ce-45a0-ad64-c31e021cd02a" containerID="647d224ef328730888451c4e783013ef7572db7b0ebb1e5b9fc85e94f443efe5" exitCode=0 Jul 06 19:06:56.195164 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:56.195079 2574 generic.go:356] "Generic (PLEG): container finished" podID="b441ae33-94ce-45a0-ad64-c31e021cd02a" containerID="d0a3b3650438856ba431543060862c4dfc8bd09e02ff20b6e2bfcfc498276fa2" exitCode=0 Jul 06 19:06:56.195164 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:56.195132 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerDied","Data":"647d224ef328730888451c4e783013ef7572db7b0ebb1e5b9fc85e94f443efe5"} Jul 06 19:06:56.195262 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:56.195176 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerDied","Data":"d0a3b3650438856ba431543060862c4dfc8bd09e02ff20b6e2bfcfc498276fa2"} Jul 06 19:06:56.196494 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:56.196472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdzmv" event={"ID":"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8","Type":"ContainerStarted","Data":"2a235419dee33292a5574c8373059eded97affd1bc624ec754e31990af36d3bd"} Jul 06 19:06:56.210399 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:56.210363 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kfdsp" podStartSLOduration=2.369224088 podStartE2EDuration="12.210351315s" totalImagesPullingTime="9.841127227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:56.209366601 +0000 UTC m=+47.904147261" watchObservedRunningTime="2026-07-06 19:06:56.210351315 +0000 UTC m=+47.905131976" Jul 06 19:06:57.205914 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:57.205876 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" event={"ID":"b441ae33-94ce-45a0-ad64-c31e021cd02a","Type":"ContainerStarted","Data":"eab347d2e0d101c60327a62e563a269518ca0ebb8bec9a92b1930c34ab224c98"} Jul 06 19:06:57.207866 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:57.207836 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdzmv" event={"ID":"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8","Type":"ContainerStarted","Data":"a61d0080e22e7fa55d0a693fecf33f8f186d3208c3f53bcefa03e7727e4b5350"} Jul 06 19:06:57.228442 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:06:57.228392 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zxqpl" podStartSLOduration=5.9391412169999995 podStartE2EDuration="47.228377265s" totalImagesPullingTime="41.289236048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:57.226893711 +0000 UTC m=+48.921674373" watchObservedRunningTime="2026-07-06 19:06:57.228377265 +0000 UTC m=+48.923157926" Jul 06 19:07:00.220113 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:00.220076 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdzmv" event={"ID":"7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8","Type":"ContainerStarted","Data":"41486c65c992e8a2b52f91158ea9eb81db58177676fa5351dce0da3a45b26b35"} Jul 06 19:07:00.237125 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:00.237082 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hdzmv" podStartSLOduration=1.98902106 podStartE2EDuration="16.237067497s" totalImagesPullingTime="14.248046437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:00.235900897 +0000 UTC m=+51.930681557" watchObservedRunningTime="2026-07-06 19:07:00.237067497 +0000 UTC m=+51.931848158" Jul 06 19:07:02.802747 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.802715 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg"] Jul 06 19:07:02.805444 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.805428 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.807730 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.807711 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:07:02.808020 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.808002 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:07:02.808627 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.808609 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:07:02.808695 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.808624 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 19:07:02.808695 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.808667 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xq9cx\"" Jul 06 19:07:02.808958 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.808940 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:07:02.809050 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.808958 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 19:07:02.812026 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.812005 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t845b"] Jul 06 19:07:02.814304 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.814270 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.816490 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.816475 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:07:02.816734 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.816713 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2xjff\"" Jul 06 19:07:02.817518 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.817246 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:07:02.817518 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.817469 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:07:02.818243 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.818221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg"] Jul 06 19:07:02.880530 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880500 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-root\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.880732 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-wtmp\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.880732 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.880732 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0a749e55-c27b-4f99-8503-a7650cd4faa7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.880732 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-sys\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.880732 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.880975 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93ff868a-f770-429a-b1a8-4ca3f11aee1f-metrics-client-ca\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.880975 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zjvk\" (UniqueName: \"kubernetes.io/projected/93ff868a-f770-429a-b1a8-4ca3f11aee1f-kube-api-access-5zjvk\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.880975 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-tls\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.880975 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snc2j\" (UniqueName: \"kubernetes.io/projected/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-api-access-snc2j\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.880975 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.880975 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880931 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.880975 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.880954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-textfile\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.881197 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.881002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a749e55-c27b-4f99-8503-a7650cd4faa7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.881197 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.881020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981305 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0a749e55-c27b-4f99-8503-a7650cd4faa7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.981305 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-sys\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981510 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.981510 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981398 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-sys\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981510 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93ff868a-f770-429a-b1a8-4ca3f11aee1f-metrics-client-ca\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zjvk\" (UniqueName: \"kubernetes.io/projected/93ff868a-f770-429a-b1a8-4ca3f11aee1f-kube-api-access-5zjvk\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-tls\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snc2j\" (UniqueName: \"kubernetes.io/projected/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-api-access-snc2j\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.981634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.981865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-textfile\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a749e55-c27b-4f99-8503-a7650cd4faa7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.981865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0a749e55-c27b-4f99-8503-a7650cd4faa7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.981865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-root\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-root\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-wtmp\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.981865 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.981855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.982266 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.982008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-wtmp\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.982266 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.982089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93ff868a-f770-429a-b1a8-4ca3f11aee1f-metrics-client-ca\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.982266 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.982113 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-textfile\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.982266 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.982131 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.982266 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:07:02.982239 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 19:07:02.982485 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:07:02.982348 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-tls podName:0a749e55-c27b-4f99-8503-a7650cd4faa7 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:03.482325897 +0000 UTC m=+55.177106547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-qkqhg" (UID: "0a749e55-c27b-4f99-8503-a7650cd4faa7") : secret "kube-state-metrics-tls" not found Jul 06 19:07:02.982485 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.982470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a749e55-c27b-4f99-8503-a7650cd4faa7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.982649 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.982629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-accelerators-collector-config\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.985075 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.985057 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-tls\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.985169 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.985126 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93ff868a-f770-429a-b1a8-4ca3f11aee1f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:02.985216 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.985200 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.993744 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.993719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snc2j\" (UniqueName: \"kubernetes.io/projected/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-api-access-snc2j\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:02.997837 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:02.997816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zjvk\" (UniqueName: \"kubernetes.io/projected/93ff868a-f770-429a-b1a8-4ca3f11aee1f-kube-api-access-5zjvk\") pod \"node-exporter-t845b\" (UID: \"93ff868a-f770-429a-b1a8-4ca3f11aee1f\") " pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:03.123127 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.123041 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t845b" Jul 06 19:07:03.132516 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:03.132477 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ff868a_f770_429a_b1a8_4ca3f11aee1f.slice/crio-5a55af5ddb9eb3c60a65d0dad3a25a63421057cb73dfd63bd6a90ff3571b8adf WatchSource:0}: Error finding container 5a55af5ddb9eb3c60a65d0dad3a25a63421057cb73dfd63bd6a90ff3571b8adf: Status 404 returned error can't find the container with id 5a55af5ddb9eb3c60a65d0dad3a25a63421057cb73dfd63bd6a90ff3571b8adf Jul 06 19:07:03.229662 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.229624 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t845b" event={"ID":"93ff868a-f770-429a-b1a8-4ca3f11aee1f","Type":"ContainerStarted","Data":"5a55af5ddb9eb3c60a65d0dad3a25a63421057cb73dfd63bd6a90ff3571b8adf"} Jul 06 19:07:03.486202 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.486166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:03.488513 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.488494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a749e55-c27b-4f99-8503-a7650cd4faa7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-qkqhg\" (UID: \"0a749e55-c27b-4f99-8503-a7650cd4faa7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:03.714725 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.714690 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" Jul 06 19:07:03.844850 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.844810 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:07:03.847914 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.847894 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.850464 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850439 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:07:03.850583 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850478 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:07:03.850676 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850658 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:07:03.850748 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850731 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:07:03.851009 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850865 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:07:03.851009 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850863 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:07:03.851009 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850890 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pp4sq\"" Jul 06 19:07:03.851009 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850874 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:07:03.851009 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.850906 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:07:03.851009 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.851009 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:07:03.859108 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.859081 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg"] Jul 06 19:07:03.862615 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.862591 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:07:03.863531 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:03.863503 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a749e55_c27b_4f99_8503_a7650cd4faa7.slice/crio-3fa2cf8fe53af4dc6fb0486b7b68135dd4f2e1edea02be3ff9d2783d34d67508 WatchSource:0}: Error finding container 3fa2cf8fe53af4dc6fb0486b7b68135dd4f2e1edea02be3ff9d2783d34d67508: Status 404 returned error can't find the container with id 3fa2cf8fe53af4dc6fb0486b7b68135dd4f2e1edea02be3ff9d2783d34d67508 Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-web-config\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznqn\" (UniqueName: \"kubernetes.io/projected/a80901b6-7de1-4382-ad1c-68f8079a7b7e-kube-api-access-fznqn\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a80901b6-7de1-4382-ad1c-68f8079a7b7e-config-out\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a80901b6-7de1-4382-ad1c-68f8079a7b7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.892468 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.891733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.992608 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.992608 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.992841 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.992841 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992675 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.992841 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a80901b6-7de1-4382-ad1c-68f8079a7b7e-config-out\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.992841 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.992841 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a80901b6-7de1-4382-ad1c-68f8079a7b7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.992841 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.993142 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-web-config\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.993142 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992883 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.993142 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.993142 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.993142 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.992961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fznqn\" (UniqueName: \"kubernetes.io/projected/a80901b6-7de1-4382-ad1c-68f8079a7b7e-kube-api-access-fznqn\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.993142 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.993067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.993438 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:07:03.993211 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-trusted-ca-bundle podName:a80901b6-7de1-4382-ad1c-68f8079a7b7e nodeName:}" failed. No retries permitted until 2026-07-06 19:07:04.493189336 +0000 UTC m=+56.187969979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a80901b6-7de1-4382-ad1c-68f8079a7b7e") : configmap references non-existent config key: ca-bundle.crt Jul 06 19:07:03.993438 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:07:03.993428 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 19:07:03.993554 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:07:03.993492 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-main-tls podName:a80901b6-7de1-4382-ad1c-68f8079a7b7e nodeName:}" failed. No retries permitted until 2026-07-06 19:07:04.493475316 +0000 UTC m=+56.188255958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a80901b6-7de1-4382-ad1c-68f8079a7b7e") : secret "alertmanager-main-tls" not found Jul 06 19:07:03.993554 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.993508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.996048 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.995986 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a80901b6-7de1-4382-ad1c-68f8079a7b7e-config-out\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.996667 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.996440 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.996667 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.996624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-web-config\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.996956 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.996870 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.997796 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.997302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.998701 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.998669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a80901b6-7de1-4382-ad1c-68f8079a7b7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.998955 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.998919 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:03.999177 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:03.999120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:04.001425 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:04.001408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznqn\" (UniqueName: \"kubernetes.io/projected/a80901b6-7de1-4382-ad1c-68f8079a7b7e-kube-api-access-fznqn\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:04.233687 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:04.233647 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" event={"ID":"0a749e55-c27b-4f99-8503-a7650cd4faa7","Type":"ContainerStarted","Data":"3fa2cf8fe53af4dc6fb0486b7b68135dd4f2e1edea02be3ff9d2783d34d67508"} Jul 06 19:07:04.497498 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:04.497411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:04.497498 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:04.497454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:04.498206 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:04.498177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a80901b6-7de1-4382-ad1c-68f8079a7b7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:04.499745 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:04.499723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a80901b6-7de1-4382-ad1c-68f8079a7b7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a80901b6-7de1-4382-ad1c-68f8079a7b7e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:04.761747 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:04.761659 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:07:04.900190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:04.900095 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:07:05.004016 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:05.003977 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:07:05.004190 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:05.004094 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:07:05.009657 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:05.009632 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:07:05.172012 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:05.171944 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80901b6_7de1_4382_ad1c_68f8079a7b7e.slice/crio-a09d567e3840e4b5c4c6babaf1cb031de300845b34a2d59a21746fb9381bad4b WatchSource:0}: Error finding container a09d567e3840e4b5c4c6babaf1cb031de300845b34a2d59a21746fb9381bad4b: Status 404 returned error can't find the container with id a09d567e3840e4b5c4c6babaf1cb031de300845b34a2d59a21746fb9381bad4b Jul 06 19:07:05.237819 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:05.237795 2574 generic.go:356] "Generic (PLEG): container finished" podID="93ff868a-f770-429a-b1a8-4ca3f11aee1f" containerID="0062334eb4705f3f2d8c98dc34301d2af659c95e2b22abd0219a2ae7c16b1297" exitCode=0 Jul 06 19:07:05.237933 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:05.237869 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t845b" event={"ID":"93ff868a-f770-429a-b1a8-4ca3f11aee1f","Type":"ContainerDied","Data":"0062334eb4705f3f2d8c98dc34301d2af659c95e2b22abd0219a2ae7c16b1297"} Jul 06 19:07:05.239235 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:05.239206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerStarted","Data":"a09d567e3840e4b5c4c6babaf1cb031de300845b34a2d59a21746fb9381bad4b"} Jul 06 19:07:05.243732 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:05.243714 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:07:06.209948 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.209923 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kfdsp" Jul 06 19:07:06.246278 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.246239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t845b" event={"ID":"93ff868a-f770-429a-b1a8-4ca3f11aee1f","Type":"ContainerStarted","Data":"68ed31aaa347ef2a577c51cebbe762b316090986211b1d2aa24f0ac9a7e46dbd"} Jul 06 19:07:06.246457 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.246336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t845b" event={"ID":"93ff868a-f770-429a-b1a8-4ca3f11aee1f","Type":"ContainerStarted","Data":"b9b2999d1d9a4cf3d07939d18ad91eb3f8fa2f981bc05e25b6492d4675a9e1a4"} Jul 06 19:07:06.249218 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.249072 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" event={"ID":"0a749e55-c27b-4f99-8503-a7650cd4faa7","Type":"ContainerStarted","Data":"6f667493a71fc5d2ecc1bdefa9272863f3afd411d62a9a8f00845499a38610e7"} Jul 06 19:07:06.249218 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.249126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" event={"ID":"0a749e55-c27b-4f99-8503-a7650cd4faa7","Type":"ContainerStarted","Data":"ac522fedef28835c16ce7561c2cd1e644197bb6c8643c8e9c414d0e8e16cb2af"} Jul 06 19:07:06.249218 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.249156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" event={"ID":"0a749e55-c27b-4f99-8503-a7650cd4faa7","Type":"ContainerStarted","Data":"8cbf419bda6852d8d8e3f1b6705f6d7d23a215cb622abc3868edba7da16ad864"} Jul 06 19:07:06.251118 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.251090 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerStarted","Data":"686440aabb7d44f06913489941ae17ab79e3373be6f6f1acddb24793338fa29e"} Jul 06 19:07:06.268787 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.266906 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t845b" podStartSLOduration=3.103255873 podStartE2EDuration="4.266887881s" totalImagesPullingTime="1.099762735s" totalInitContainerRuntime="63.869273ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:06.265919863 +0000 UTC m=+57.960700541" watchObservedRunningTime="2026-07-06 19:07:06.266887881 +0000 UTC m=+57.961668544" Jul 06 19:07:06.315674 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:06.315625 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-qkqhg" podStartSLOduration=2.984758145 podStartE2EDuration="4.315609778s" totalImagesPullingTime="1.330851633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:06.315488355 +0000 UTC m=+58.010269017" watchObservedRunningTime="2026-07-06 19:07:06.315609778 +0000 UTC m=+58.010390439" Jul 06 19:07:07.095028 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.094995 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f5b6667c8-kljwc"] Jul 06 19:07:07.097205 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.097190 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.100413 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.100272 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 19:07:07.100413 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.100302 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5l94us7ottq5o\"" Jul 06 19:07:07.100413 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.100362 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:07:07.100413 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.100381 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ffmwc\"" Jul 06 19:07:07.100724 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.100395 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 19:07:07.100724 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.100468 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 19:07:07.106344 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.106319 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f5b6667c8-kljwc"] Jul 06 19:07:07.123713 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.123690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-secret-metrics-server-client-certs\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.123842 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.123736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70630e5e-c969-4996-9a78-ac92a5bc5b15-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.123842 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.123776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x795\" (UniqueName: \"kubernetes.io/projected/70630e5e-c969-4996-9a78-ac92a5bc5b15-kube-api-access-7x795\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.123842 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.123797 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-client-ca-bundle\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.123842 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.123821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70630e5e-c969-4996-9a78-ac92a5bc5b15-audit-log\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.123976 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.123876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-secret-metrics-server-tls\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.123976 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.123893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70630e5e-c969-4996-9a78-ac92a5bc5b15-metrics-server-audit-profiles\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.162515 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.162498 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c8fc68c48-jqflb" Jul 06 19:07:07.224943 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.224908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x795\" (UniqueName: \"kubernetes.io/projected/70630e5e-c969-4996-9a78-ac92a5bc5b15-kube-api-access-7x795\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.225423 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.224956 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-client-ca-bundle\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.225423 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.225026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70630e5e-c969-4996-9a78-ac92a5bc5b15-audit-log\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.225423 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.225231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-secret-metrics-server-tls\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.225423 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.225268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70630e5e-c969-4996-9a78-ac92a5bc5b15-metrics-server-audit-profiles\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.225629 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.225434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-secret-metrics-server-client-certs\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.225629 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.225495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70630e5e-c969-4996-9a78-ac92a5bc5b15-audit-log\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.225629 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.225495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70630e5e-c969-4996-9a78-ac92a5bc5b15-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.226188 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.226162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70630e5e-c969-4996-9a78-ac92a5bc5b15-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.226481 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.226462 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70630e5e-c969-4996-9a78-ac92a5bc5b15-metrics-server-audit-profiles\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.227961 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.227941 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-client-ca-bundle\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.228129 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.228112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-secret-metrics-server-tls\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.228331 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.228311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70630e5e-c969-4996-9a78-ac92a5bc5b15-secret-metrics-server-client-certs\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.242438 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.242419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x795\" (UniqueName: \"kubernetes.io/projected/70630e5e-c969-4996-9a78-ac92a5bc5b15-kube-api-access-7x795\") pod \"metrics-server-6f5b6667c8-kljwc\" (UID: \"70630e5e-c969-4996-9a78-ac92a5bc5b15\") " pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.258586 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.258559 2574 generic.go:356] "Generic (PLEG): container finished" podID="a80901b6-7de1-4382-ad1c-68f8079a7b7e" containerID="686440aabb7d44f06913489941ae17ab79e3373be6f6f1acddb24793338fa29e" exitCode=0 Jul 06 19:07:07.258698 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.258647 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerDied","Data":"686440aabb7d44f06913489941ae17ab79e3373be6f6f1acddb24793338fa29e"} Jul 06 19:07:07.408485 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.408392 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:07.532461 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:07.532423 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f5b6667c8-kljwc"] Jul 06 19:07:07.535852 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:07.535828 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70630e5e_c969_4996_9a78_ac92a5bc5b15.slice/crio-2d221b392cdb234f81cedc66f9faddaca1ab8bfbdeda8745d97ecd05677c2548 WatchSource:0}: Error finding container 2d221b392cdb234f81cedc66f9faddaca1ab8bfbdeda8745d97ecd05677c2548: Status 404 returned error can't find the container with id 2d221b392cdb234f81cedc66f9faddaca1ab8bfbdeda8745d97ecd05677c2548 Jul 06 19:07:08.263419 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:08.263387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" event={"ID":"70630e5e-c969-4996-9a78-ac92a5bc5b15","Type":"ContainerStarted","Data":"2d221b392cdb234f81cedc66f9faddaca1ab8bfbdeda8745d97ecd05677c2548"} Jul 06 19:07:09.004567 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.004535 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:07:09.007490 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.007470 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.010724 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.010564 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:07:09.010724 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.010582 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:07:09.010724 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.010662 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6nsw8\"" Jul 06 19:07:09.010724 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.010674 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:07:09.011025 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.010878 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-89qd841kvci8t\"" Jul 06 19:07:09.011665 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.011644 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:07:09.012337 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.012311 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:07:09.012436 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.012314 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:07:09.012436 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.012315 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:07:09.012790 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.012772 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:07:09.012876 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.012856 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:07:09.013083 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.013064 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:07:09.013226 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.013204 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:07:09.013774 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.013736 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:07:09.022391 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.022369 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:07:09.026751 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.026731 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:07:09.030440 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.030416 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:07:09.042147 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042250 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042250 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-config\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042614 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042614 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042614 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042614 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042614 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldsg6\" (UniqueName: \"kubernetes.io/projected/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-kube-api-access-ldsg6\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042791 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042791 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042791 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042791 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042913 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042913 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042817 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.042913 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.042839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.119281 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.119252 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-224lr" Jul 06 19:07:09.144038 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144038 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144041 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144267 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144267 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144267 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldsg6\" (UniqueName: \"kubernetes.io/projected/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-kube-api-access-ldsg6\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144267 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144267 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144267 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144267 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144334 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-config\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.145074 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.145074 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.145074 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.144929 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.145918 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.145274 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.145918 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.145593 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.145918 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.145655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.146832 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.146514 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.147042 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.147019 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.148271 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.148244 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.149024 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.148999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.149116 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.149069 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.150194 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.149824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.150194 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.149859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.150194 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.150137 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-config\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.150194 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.150153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.150469 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.150280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.150555 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.150527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.151156 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.151133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.151281 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.151261 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.151527 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.151497 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.151714 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.151697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.156209 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.156161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldsg6\" (UniqueName: \"kubernetes.io/projected/bbccfd8d-8bcb-46df-bf8c-e36297c73cdc-kube-api-access-ldsg6\") pod \"prometheus-k8s-0\" (UID: \"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.319498 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.319414 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:09.590985 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:09.590940 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:07:09.595767 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:09.595577 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbccfd8d_8bcb_46df_bf8c_e36297c73cdc.slice/crio-c48a3b236621d588868b71a0fcf57cfa2c9e9413a41b58ff785df421f21850a0 WatchSource:0}: Error finding container c48a3b236621d588868b71a0fcf57cfa2c9e9413a41b58ff785df421f21850a0: Status 404 returned error can't find the container with id c48a3b236621d588868b71a0fcf57cfa2c9e9413a41b58ff785df421f21850a0 Jul 06 19:07:10.272809 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.272772 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" event={"ID":"70630e5e-c969-4996-9a78-ac92a5bc5b15","Type":"ContainerStarted","Data":"aa1575c6854699b2a520da1738efd3a40ad7cf7a9e8c8490b23d6033310e8d70"} Jul 06 19:07:10.276662 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.276626 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerStarted","Data":"fa545f95c31d498fadfba1c3fa0906ead740678ece73df84e6fa5b44c996b3a0"} Jul 06 19:07:10.276812 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.276705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerStarted","Data":"6dfce3d45e7cafbd280399649889076a654fc7d7033b5835a3982b1266b23773"} Jul 06 19:07:10.276812 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.276748 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerStarted","Data":"eef5618e579f985f50f0867a51ca62596163ae76d12d01c6689de2e150809748"} Jul 06 19:07:10.276905 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.276849 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerStarted","Data":"4c7049bb66910c885df623187c36991168aa63bb955554cece223f6d6cc2916d"} Jul 06 19:07:10.276953 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.276905 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerStarted","Data":"990594d9185dd481dd35bc1e1a8cd56cf755eae9100471d462f377178797200a"} Jul 06 19:07:10.278721 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.278692 2574 generic.go:356] "Generic (PLEG): container finished" podID="bbccfd8d-8bcb-46df-bf8c-e36297c73cdc" containerID="e3604c7ea6622978b1fd7d4ccac71a4620af25ac22fe77798bfd7b7f6148b5c1" exitCode=0 Jul 06 19:07:10.278846 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.278737 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc","Type":"ContainerDied","Data":"e3604c7ea6622978b1fd7d4ccac71a4620af25ac22fe77798bfd7b7f6148b5c1"} Jul 06 19:07:10.278846 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.278792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc","Type":"ContainerStarted","Data":"c48a3b236621d588868b71a0fcf57cfa2c9e9413a41b58ff785df421f21850a0"} Jul 06 19:07:10.293119 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:10.293047 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" podStartSLOduration=1.383370535 podStartE2EDuration="3.293033308s" totalImagesPullingTime="1.909662773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:10.292366801 +0000 UTC m=+61.987147461" watchObservedRunningTime="2026-07-06 19:07:10.293033308 +0000 UTC m=+61.987813970" Jul 06 19:07:11.286306 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:11.286261 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a80901b6-7de1-4382-ad1c-68f8079a7b7e","Type":"ContainerStarted","Data":"e2ad0c11c248a48e8ea58443e9ecb2227e33ff61c17dd1f67d445bedcc1580db"} Jul 06 19:07:11.314986 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:11.314934 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.424896722 podStartE2EDuration="8.314919294s" totalImagesPullingTime="3.869524876s" totalInitContainerRuntime="20.497696ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:11.313441957 +0000 UTC m=+63.008222619" watchObservedRunningTime="2026-07-06 19:07:11.314919294 +0000 UTC m=+63.009699954" Jul 06 19:07:13.143137 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.143106 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75b95b787b-56dwf"] Jul 06 19:07:13.148591 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.148566 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.160406 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.160382 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b95b787b-56dwf"] Jul 06 19:07:13.288452 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.288415 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-serving-cert\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.288641 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.288459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-service-ca\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.288641 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.288486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-oauth-config\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.288745 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.288641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-oauth-serving-cert\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.288745 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.288727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-console-config\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.288843 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.288775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96g6j\" (UniqueName: \"kubernetes.io/projected/657de062-f6a6-4fbc-9b62-b497cf914a45-kube-api-access-96g6j\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.288843 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.288821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-trusted-ca-bundle\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.390403 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.390368 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-console-config\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.390564 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.390424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96g6j\" (UniqueName: \"kubernetes.io/projected/657de062-f6a6-4fbc-9b62-b497cf914a45-kube-api-access-96g6j\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.390564 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.390505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-trusted-ca-bundle\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.390689 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.390583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-serving-cert\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.390689 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.390603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-service-ca\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.390689 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.390640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-oauth-config\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.390829 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.390716 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-oauth-serving-cert\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.391575 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.391511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-service-ca\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.391575 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.391511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-trusted-ca-bundle\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.391707 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.391579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-console-config\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.391707 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.391634 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-oauth-serving-cert\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.393682 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.393628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-oauth-config\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.393787 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.393699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-serving-cert\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.400562 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.400541 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96g6j\" (UniqueName: \"kubernetes.io/projected/657de062-f6a6-4fbc-9b62-b497cf914a45-kube-api-access-96g6j\") pod \"console-75b95b787b-56dwf\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.458795 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.458750 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:13.693623 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.693542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:07:13.693623 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.693604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:07:13.696360 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.696335 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:07:13.696725 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.696708 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:07:13.706411 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.706390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40b8351c-7389-4119-a482-1c3d0540468a-metrics-certs\") pod \"network-metrics-daemon-chqfs\" (UID: \"40b8351c-7389-4119-a482-1c3d0540468a\") " pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:07:13.706529 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.706419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137e73ff-87f0-44f7-aa8d-f7673d57fd4e-original-pull-secret\") pod \"global-pull-secret-syncer-ph444\" (UID: \"137e73ff-87f0-44f7-aa8d-f7673d57fd4e\") " pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:07:13.709605 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.709583 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-85brg\"" Jul 06 19:07:13.718321 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.718281 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chqfs" Jul 06 19:07:13.729724 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.729705 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ph444" Jul 06 19:07:13.794613 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.794581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:07:13.797322 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.797304 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:07:13.807923 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.807905 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:07:13.818515 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:13.818496 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vln2k\" (UniqueName: \"kubernetes.io/projected/ec97af13-588c-42d4-90ce-94843b4d9ed6-kube-api-access-vln2k\") pod \"network-check-target-wshwj\" (UID: \"ec97af13-588c-42d4-90ce-94843b4d9ed6\") " pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:07:14.009568 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.009528 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b95b787b-56dwf"] Jul 06 19:07:14.012498 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:14.012471 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657de062_f6a6_4fbc_9b62_b497cf914a45.slice/crio-06239f5eb6ecc340b2ff5496df28d314e57a58751b20a7176ed1017949c82a24 WatchSource:0}: Error finding container 06239f5eb6ecc340b2ff5496df28d314e57a58751b20a7176ed1017949c82a24: Status 404 returned error can't find the container with id 06239f5eb6ecc340b2ff5496df28d314e57a58751b20a7176ed1017949c82a24 Jul 06 19:07:14.023364 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.023340 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ph444"] Jul 06 19:07:14.023746 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.023730 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xsmh6\"" Jul 06 19:07:14.029927 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.029885 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:07:14.038499 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.038477 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chqfs"] Jul 06 19:07:14.197552 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:14.197514 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137e73ff_87f0_44f7_aa8d_f7673d57fd4e.slice/crio-4ff80e15af4d5b4f8446a780513f80a4f478fe5f1c5e019f4707003ee836cfeb WatchSource:0}: Error finding container 4ff80e15af4d5b4f8446a780513f80a4f478fe5f1c5e019f4707003ee836cfeb: Status 404 returned error can't find the container with id 4ff80e15af4d5b4f8446a780513f80a4f478fe5f1c5e019f4707003ee836cfeb Jul 06 19:07:14.198170 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:14.198135 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b8351c_7389_4119_a482_1c3d0540468a.slice/crio-1e3d2d1896363e579ca93a82c47843647d2a1a78bd2bd5b66f24831e931c77cb WatchSource:0}: Error finding container 1e3d2d1896363e579ca93a82c47843647d2a1a78bd2bd5b66f24831e931c77cb: Status 404 returned error can't find the container with id 1e3d2d1896363e579ca93a82c47843647d2a1a78bd2bd5b66f24831e931c77cb Jul 06 19:07:14.301178 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.301146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chqfs" event={"ID":"40b8351c-7389-4119-a482-1c3d0540468a","Type":"ContainerStarted","Data":"1e3d2d1896363e579ca93a82c47843647d2a1a78bd2bd5b66f24831e931c77cb"} Jul 06 19:07:14.302946 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.302916 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b95b787b-56dwf" event={"ID":"657de062-f6a6-4fbc-9b62-b497cf914a45","Type":"ContainerStarted","Data":"06239f5eb6ecc340b2ff5496df28d314e57a58751b20a7176ed1017949c82a24"} Jul 06 19:07:14.304541 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.304511 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ph444" event={"ID":"137e73ff-87f0-44f7-aa8d-f7673d57fd4e","Type":"ContainerStarted","Data":"4ff80e15af4d5b4f8446a780513f80a4f478fe5f1c5e019f4707003ee836cfeb"} Jul 06 19:07:14.355010 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:14.354987 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wshwj"] Jul 06 19:07:14.357520 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:07:14.357492 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec97af13_588c_42d4_90ce_94843b4d9ed6.slice/crio-adaef60bcab491d39697df0b059763997e22045a84b80ddb511b1829568995db WatchSource:0}: Error finding container adaef60bcab491d39697df0b059763997e22045a84b80ddb511b1829568995db: Status 404 returned error can't find the container with id adaef60bcab491d39697df0b059763997e22045a84b80ddb511b1829568995db Jul 06 19:07:15.311678 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:15.311584 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wshwj" event={"ID":"ec97af13-588c-42d4-90ce-94843b4d9ed6","Type":"ContainerStarted","Data":"adaef60bcab491d39697df0b059763997e22045a84b80ddb511b1829568995db"} Jul 06 19:07:15.314914 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:15.314782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc","Type":"ContainerStarted","Data":"2389ca1de4038ab4a5571c49a9294173ad63fc5dec05f76564e5ebaedab0e134"} Jul 06 19:07:15.314914 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:15.314854 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc","Type":"ContainerStarted","Data":"3ddf73d9c5f9c70f64f38b44af86d2f8f74b5091337dd2b1c3c13def93bdc5e6"} Jul 06 19:07:15.317723 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:15.316850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b95b787b-56dwf" event={"ID":"657de062-f6a6-4fbc-9b62-b497cf914a45","Type":"ContainerStarted","Data":"b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8"} Jul 06 19:07:15.342120 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:15.342071 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75b95b787b-56dwf" podStartSLOduration=2.342054043 podStartE2EDuration="2.342054043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:15.341006147 +0000 UTC m=+67.035786810" watchObservedRunningTime="2026-07-06 19:07:15.342054043 +0000 UTC m=+67.036834709" Jul 06 19:07:16.324461 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:16.324233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chqfs" event={"ID":"40b8351c-7389-4119-a482-1c3d0540468a","Type":"ContainerStarted","Data":"84bff4be1c94240f7a2990ba2e051b360463c2ce30fb8e8ac5cdc275c623946f"} Jul 06 19:07:16.324461 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:16.324311 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chqfs" event={"ID":"40b8351c-7389-4119-a482-1c3d0540468a","Type":"ContainerStarted","Data":"735cc2ef83dfb16f4476edf674cdad0b5cf6f9b0829a7067903249dbc9a5e7bf"} Jul 06 19:07:16.344822 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:16.344745 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-chqfs" podStartSLOduration=65.111587685 podStartE2EDuration="1m6.344725892s" totalImagesPullingTime="1.233138207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:16.343349595 +0000 UTC m=+68.038130257" watchObservedRunningTime="2026-07-06 19:07:16.344725892 +0000 UTC m=+68.039506553" Jul 06 19:07:17.333860 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:17.333807 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc","Type":"ContainerStarted","Data":"4b7b6f52bbc0bf56d96cecb5e075ba9b0cbe1db80ab7860846dbd392782bcd0f"} Jul 06 19:07:17.334331 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:17.333899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc","Type":"ContainerStarted","Data":"288536aa7d20f17ab8950ae62d3abc816dc421419a97ede3b547a53bfba6c28b"} Jul 06 19:07:17.334331 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:17.333951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc","Type":"ContainerStarted","Data":"b8334c23b594fde9fa44f9ef885337b663f20ef16957cd0e1bd72057be7b9222"} Jul 06 19:07:17.334331 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:17.333995 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbccfd8d-8bcb-46df-bf8c-e36297c73cdc","Type":"ContainerStarted","Data":"20de6faf47ca3e4f2cf6c6c592d7dc9a530265b7623b10cc535de67c81de4958"} Jul 06 19:07:17.369522 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:17.369458 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.97847832 podStartE2EDuration="9.369436909s" totalImagesPullingTime="6.366760493s" totalInitContainerRuntime="24.198096ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:17.367767144 +0000 UTC m=+69.062547817" watchObservedRunningTime="2026-07-06 19:07:17.369436909 +0000 UTC m=+69.064217572" Jul 06 19:07:19.319717 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:19.319677 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:07:20.350861 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:20.350828 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ph444" event={"ID":"137e73ff-87f0-44f7-aa8d-f7673d57fd4e","Type":"ContainerStarted","Data":"969774ef1cc9b3a03457fcddd4f260f2472cde09bb2ce72243032c04399a11cc"} Jul 06 19:07:20.352525 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:20.352499 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wshwj" event={"ID":"ec97af13-588c-42d4-90ce-94843b4d9ed6","Type":"ContainerStarted","Data":"4c7459081d7d8cab7713a815c39c508f7a72f9fda400cb25e28eda3d61a8c3cc"} Jul 06 19:07:20.352663 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:20.352644 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:07:20.368225 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:20.368179 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ph444" podStartSLOduration=64.946977963 podStartE2EDuration="1m10.368165499s" totalImagesPullingTime="5.421187536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:20.36750217 +0000 UTC m=+72.062282843" watchObservedRunningTime="2026-07-06 19:07:20.368165499 +0000 UTC m=+72.062946159" Jul 06 19:07:20.384741 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:20.384702 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wshwj" podStartSLOduration=65.103673775 podStartE2EDuration="1m10.384687049s" totalImagesPullingTime="5.281013274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:20.384304029 +0000 UTC m=+72.079084688" watchObservedRunningTime="2026-07-06 19:07:20.384687049 +0000 UTC m=+72.079467713" Jul 06 19:07:23.459553 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:23.459524 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:23.460118 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:23.459574 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:23.464204 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:23.464185 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:24.371973 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:24.371947 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:07:24.421813 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:24.421784 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64bcbbf4bf-rdrlh"] Jul 06 19:07:27.408793 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:27.408746 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:27.409281 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:27.408825 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:47.414350 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:47.414315 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:47.419139 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:47.419102 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f5b6667c8-kljwc" Jul 06 19:07:49.448934 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.448870 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64bcbbf4bf-rdrlh" podUID="3cda7abd-16e2-4af4-80f8-858e3466d073" containerName="console" containerID="cri-o://e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e" gracePeriod=15 Jul 06 19:07:49.740904 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.740882 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:07:49.811677 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.811645 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x4r5\" (UniqueName: \"kubernetes.io/projected/3cda7abd-16e2-4af4-80f8-858e3466d073-kube-api-access-2x4r5\") pod \"3cda7abd-16e2-4af4-80f8-858e3466d073\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " Jul 06 19:07:49.811849 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.811696 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-serving-cert\") pod \"3cda7abd-16e2-4af4-80f8-858e3466d073\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " Jul 06 19:07:49.811849 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.811712 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-oauth-serving-cert\") pod \"3cda7abd-16e2-4af4-80f8-858e3466d073\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " Jul 06 19:07:49.811849 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.811728 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-trusted-ca-bundle\") pod \"3cda7abd-16e2-4af4-80f8-858e3466d073\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " Jul 06 19:07:49.811849 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.811775 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-oauth-config\") pod \"3cda7abd-16e2-4af4-80f8-858e3466d073\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " Jul 06 19:07:49.811849 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.811822 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-service-ca\") pod \"3cda7abd-16e2-4af4-80f8-858e3466d073\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " Jul 06 19:07:49.812117 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.811856 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-console-config\") pod \"3cda7abd-16e2-4af4-80f8-858e3466d073\" (UID: \"3cda7abd-16e2-4af4-80f8-858e3466d073\") " Jul 06 19:07:49.812189 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.812156 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3cda7abd-16e2-4af4-80f8-858e3466d073" (UID: "3cda7abd-16e2-4af4-80f8-858e3466d073"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:07:49.812240 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.812191 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-service-ca" (OuterVolumeSpecName: "service-ca") pod "3cda7abd-16e2-4af4-80f8-858e3466d073" (UID: "3cda7abd-16e2-4af4-80f8-858e3466d073"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:07:49.812376 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.812358 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3cda7abd-16e2-4af4-80f8-858e3466d073" (UID: "3cda7abd-16e2-4af4-80f8-858e3466d073"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:07:49.812497 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.812469 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-console-config" (OuterVolumeSpecName: "console-config") pod "3cda7abd-16e2-4af4-80f8-858e3466d073" (UID: "3cda7abd-16e2-4af4-80f8-858e3466d073"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:07:49.814116 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.814089 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cda7abd-16e2-4af4-80f8-858e3466d073-kube-api-access-2x4r5" (OuterVolumeSpecName: "kube-api-access-2x4r5") pod "3cda7abd-16e2-4af4-80f8-858e3466d073" (UID: "3cda7abd-16e2-4af4-80f8-858e3466d073"). InnerVolumeSpecName "kube-api-access-2x4r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:07:49.814116 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.814097 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3cda7abd-16e2-4af4-80f8-858e3466d073" (UID: "3cda7abd-16e2-4af4-80f8-858e3466d073"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:07:49.814257 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.814148 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3cda7abd-16e2-4af4-80f8-858e3466d073" (UID: "3cda7abd-16e2-4af4-80f8-858e3466d073"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:07:49.912528 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.912502 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-serving-cert\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:07:49.912528 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.912523 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-oauth-serving-cert\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:07:49.912528 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.912532 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-trusted-ca-bundle\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:07:49.912706 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.912540 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cda7abd-16e2-4af4-80f8-858e3466d073-console-oauth-config\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:07:49.912706 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.912549 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-service-ca\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:07:49.912706 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.912556 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cda7abd-16e2-4af4-80f8-858e3466d073-console-config\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:07:49.912706 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:49.912564 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x4r5\" (UniqueName: \"kubernetes.io/projected/3cda7abd-16e2-4af4-80f8-858e3466d073-kube-api-access-2x4r5\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:07:50.466934 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.466850 2574 generic.go:356] "Generic (PLEG): container finished" podID="3cda7abd-16e2-4af4-80f8-858e3466d073" containerID="e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e" exitCode=0 Jul 06 19:07:50.466934 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.466921 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcbbf4bf-rdrlh" Jul 06 19:07:50.467334 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.466928 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcbbf4bf-rdrlh" event={"ID":"3cda7abd-16e2-4af4-80f8-858e3466d073","Type":"ContainerDied","Data":"e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e"} Jul 06 19:07:50.467334 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.467005 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcbbf4bf-rdrlh" event={"ID":"3cda7abd-16e2-4af4-80f8-858e3466d073","Type":"ContainerDied","Data":"14fd433eaef848c6efa2c2c79aeb99a898bb7ce5bf704d6e1d86574dd2dc050f"} Jul 06 19:07:50.467334 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.467028 2574 scope.go:117] "RemoveContainer" containerID="e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e" Jul 06 19:07:50.475266 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.475244 2574 scope.go:117] "RemoveContainer" containerID="e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e" Jul 06 19:07:50.475580 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:07:50.475556 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e\": container with ID starting with e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e not found: ID does not exist" containerID="e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e" Jul 06 19:07:50.475680 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.475588 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e"} err="failed to get container status \"e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e\": rpc error: code = NotFound desc = could not find container \"e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e\": container with ID starting with e83f3032a720d12028068b14ff9027d8628dded01c9b14b1815eef5b842a8a9e not found: ID does not exist" Jul 06 19:07:50.493026 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.493003 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64bcbbf4bf-rdrlh"] Jul 06 19:07:50.499973 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.499947 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64bcbbf4bf-rdrlh"] Jul 06 19:07:50.888643 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:50.888612 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cda7abd-16e2-4af4-80f8-858e3466d073" path="/var/lib/kubelet/pods/3cda7abd-16e2-4af4-80f8-858e3466d073/volumes" Jul 06 19:07:51.358552 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:07:51.358527 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wshwj" Jul 06 19:08:09.320600 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:09.320565 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:09.340726 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:09.340693 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:09.550482 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:09.550458 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:31.422168 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.422135 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74775cfcf8-d57jh"] Jul 06 19:08:31.422570 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.422450 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cda7abd-16e2-4af4-80f8-858e3466d073" containerName="console" Jul 06 19:08:31.422570 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.422465 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cda7abd-16e2-4af4-80f8-858e3466d073" containerName="console" Jul 06 19:08:31.422570 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.422543 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cda7abd-16e2-4af4-80f8-858e3466d073" containerName="console" Jul 06 19:08:31.424436 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.424421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.435678 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.435629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-serving-cert\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.435837 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.435680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-oauth-config\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.435837 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.435721 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-oauth-serving-cert\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.435837 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.435782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvqjt\" (UniqueName: \"kubernetes.io/projected/49b4ee29-3315-4796-8c54-ae9abf049dd3-kube-api-access-bvqjt\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.435837 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.435831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-config\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.436088 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.435864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-trusted-ca-bundle\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.436088 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.435898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-service-ca\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.449303 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.449259 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74775cfcf8-d57jh"] Jul 06 19:08:31.536552 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.536516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-oauth-serving-cert\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.536715 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.536584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvqjt\" (UniqueName: \"kubernetes.io/projected/49b4ee29-3315-4796-8c54-ae9abf049dd3-kube-api-access-bvqjt\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.536715 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.536625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-config\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.536715 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.536652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-trusted-ca-bundle\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.536715 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.536679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-service-ca\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.536929 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.536733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-serving-cert\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.536929 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.536761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-oauth-config\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.537397 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.537372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-oauth-serving-cert\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.537520 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.537503 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-trusted-ca-bundle\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.537588 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.537447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-service-ca\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.537588 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.537429 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-config\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.539106 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.539090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-oauth-config\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.539225 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.539208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-serving-cert\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.545941 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.545919 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvqjt\" (UniqueName: \"kubernetes.io/projected/49b4ee29-3315-4796-8c54-ae9abf049dd3-kube-api-access-bvqjt\") pod \"console-74775cfcf8-d57jh\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.734115 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.734091 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:31.856158 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:31.856133 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74775cfcf8-d57jh"] Jul 06 19:08:31.858358 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:08:31.858332 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b4ee29_3315_4796_8c54_ae9abf049dd3.slice/crio-937d92db75a17cb29e55b9483958a2c7d3f8318c642c4c9761a47fd4a962e799 WatchSource:0}: Error finding container 937d92db75a17cb29e55b9483958a2c7d3f8318c642c4c9761a47fd4a962e799: Status 404 returned error can't find the container with id 937d92db75a17cb29e55b9483958a2c7d3f8318c642c4c9761a47fd4a962e799 Jul 06 19:08:32.621108 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:32.621070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74775cfcf8-d57jh" event={"ID":"49b4ee29-3315-4796-8c54-ae9abf049dd3","Type":"ContainerStarted","Data":"8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619"} Jul 06 19:08:32.621502 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:32.621119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74775cfcf8-d57jh" event={"ID":"49b4ee29-3315-4796-8c54-ae9abf049dd3","Type":"ContainerStarted","Data":"937d92db75a17cb29e55b9483958a2c7d3f8318c642c4c9761a47fd4a962e799"} Jul 06 19:08:32.649463 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:32.649424 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74775cfcf8-d57jh" podStartSLOduration=1.649410439 podStartE2EDuration="1.649410439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:32.648015718 +0000 UTC m=+144.342796379" watchObservedRunningTime="2026-07-06 19:08:32.649410439 +0000 UTC m=+144.344191100" Jul 06 19:08:41.735111 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:41.735077 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:41.735626 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:41.735213 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:41.739967 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:41.739947 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:42.660347 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:42.660322 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:08:42.718825 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:08:42.718797 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b95b787b-56dwf"] Jul 06 19:09:07.739302 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:07.739183 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75b95b787b-56dwf" podUID="657de062-f6a6-4fbc-9b62-b497cf914a45" containerName="console" containerID="cri-o://b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8" gracePeriod=15 Jul 06 19:09:07.976874 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:07.976849 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:09:08.149704 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.149621 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-oauth-config\") pod \"657de062-f6a6-4fbc-9b62-b497cf914a45\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " Jul 06 19:09:08.149704 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.149661 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-service-ca\") pod \"657de062-f6a6-4fbc-9b62-b497cf914a45\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " Jul 06 19:09:08.149942 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.149739 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96g6j\" (UniqueName: \"kubernetes.io/projected/657de062-f6a6-4fbc-9b62-b497cf914a45-kube-api-access-96g6j\") pod \"657de062-f6a6-4fbc-9b62-b497cf914a45\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " Jul 06 19:09:08.149942 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.149765 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-serving-cert\") pod \"657de062-f6a6-4fbc-9b62-b497cf914a45\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " Jul 06 19:09:08.149942 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.149929 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-console-config\") pod \"657de062-f6a6-4fbc-9b62-b497cf914a45\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " Jul 06 19:09:08.150101 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.149976 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-trusted-ca-bundle\") pod \"657de062-f6a6-4fbc-9b62-b497cf914a45\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " Jul 06 19:09:08.150101 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.150004 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-oauth-serving-cert\") pod \"657de062-f6a6-4fbc-9b62-b497cf914a45\" (UID: \"657de062-f6a6-4fbc-9b62-b497cf914a45\") " Jul 06 19:09:08.150220 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.150187 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-service-ca" (OuterVolumeSpecName: "service-ca") pod "657de062-f6a6-4fbc-9b62-b497cf914a45" (UID: "657de062-f6a6-4fbc-9b62-b497cf914a45"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:08.150279 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.150221 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-console-config" (OuterVolumeSpecName: "console-config") pod "657de062-f6a6-4fbc-9b62-b497cf914a45" (UID: "657de062-f6a6-4fbc-9b62-b497cf914a45"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:08.150531 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.150421 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "657de062-f6a6-4fbc-9b62-b497cf914a45" (UID: "657de062-f6a6-4fbc-9b62-b497cf914a45"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:08.150613 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.150591 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "657de062-f6a6-4fbc-9b62-b497cf914a45" (UID: "657de062-f6a6-4fbc-9b62-b497cf914a45"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:08.151981 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.151945 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "657de062-f6a6-4fbc-9b62-b497cf914a45" (UID: "657de062-f6a6-4fbc-9b62-b497cf914a45"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:08.152080 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.151985 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657de062-f6a6-4fbc-9b62-b497cf914a45-kube-api-access-96g6j" (OuterVolumeSpecName: "kube-api-access-96g6j") pod "657de062-f6a6-4fbc-9b62-b497cf914a45" (UID: "657de062-f6a6-4fbc-9b62-b497cf914a45"). InnerVolumeSpecName "kube-api-access-96g6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:08.152080 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.151998 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "657de062-f6a6-4fbc-9b62-b497cf914a45" (UID: "657de062-f6a6-4fbc-9b62-b497cf914a45"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:08.251443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.251399 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96g6j\" (UniqueName: \"kubernetes.io/projected/657de062-f6a6-4fbc-9b62-b497cf914a45-kube-api-access-96g6j\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:09:08.251443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.251435 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-serving-cert\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:09:08.251443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.251445 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-console-config\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:09:08.251443 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.251457 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-trusted-ca-bundle\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:09:08.251699 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.251465 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-oauth-serving-cert\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:09:08.251699 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.251473 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/657de062-f6a6-4fbc-9b62-b497cf914a45-console-oauth-config\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:09:08.251699 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.251483 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/657de062-f6a6-4fbc-9b62-b497cf914a45-service-ca\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:09:08.755446 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.755407 2574 generic.go:356] "Generic (PLEG): container finished" podID="657de062-f6a6-4fbc-9b62-b497cf914a45" containerID="b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8" exitCode=0 Jul 06 19:09:08.755446 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.755452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b95b787b-56dwf" event={"ID":"657de062-f6a6-4fbc-9b62-b497cf914a45","Type":"ContainerDied","Data":"b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8"} Jul 06 19:09:08.755940 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.755464 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b95b787b-56dwf" Jul 06 19:09:08.755940 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.755499 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b95b787b-56dwf" event={"ID":"657de062-f6a6-4fbc-9b62-b497cf914a45","Type":"ContainerDied","Data":"06239f5eb6ecc340b2ff5496df28d314e57a58751b20a7176ed1017949c82a24"} Jul 06 19:09:08.755940 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.755520 2574 scope.go:117] "RemoveContainer" containerID="b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8" Jul 06 19:09:08.764591 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.764562 2574 scope.go:117] "RemoveContainer" containerID="b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8" Jul 06 19:09:08.764861 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:09:08.764838 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8\": container with ID starting with b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8 not found: ID does not exist" containerID="b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8" Jul 06 19:09:08.764912 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.764875 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8"} err="failed to get container status \"b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8\": rpc error: code = NotFound desc = could not find container \"b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8\": container with ID starting with b0fbe73b805c033ece4c06a769d0dc1434853a9dbc51752ba66dd1aa8c71e8f8 not found: ID does not exist" Jul 06 19:09:08.777398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.777377 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b95b787b-56dwf"] Jul 06 19:09:08.782084 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.782065 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75b95b787b-56dwf"] Jul 06 19:09:08.887855 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:08.887827 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="657de062-f6a6-4fbc-9b62-b497cf914a45" path="/var/lib/kubelet/pods/657de062-f6a6-4fbc-9b62-b497cf914a45/volumes" Jul 06 19:09:53.673395 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.673361 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc"] Jul 06 19:09:53.673799 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.673650 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657de062-f6a6-4fbc-9b62-b497cf914a45" containerName="console" Jul 06 19:09:53.673799 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.673661 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="657de062-f6a6-4fbc-9b62-b497cf914a45" containerName="console" Jul 06 19:09:53.673799 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.673723 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="657de062-f6a6-4fbc-9b62-b497cf914a45" containerName="console" Jul 06 19:09:53.675694 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.675669 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" Jul 06 19:09:53.678145 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.678123 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:09:53.679058 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.679037 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h55hq\"" Jul 06 19:09:53.679137 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.679058 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:09:53.686457 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.686440 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc"] Jul 06 19:09:53.830166 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.830118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8zv6\" (UniqueName: \"kubernetes.io/projected/7afedb56-59db-4377-a006-5211d46d892d-kube-api-access-r8zv6\") pod \"openshift-lws-operator-fd8ccff4c-h4pdc\" (UID: \"7afedb56-59db-4377-a006-5211d46d892d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" Jul 06 19:09:53.830370 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.830179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afedb56-59db-4377-a006-5211d46d892d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4pdc\" (UID: \"7afedb56-59db-4377-a006-5211d46d892d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" Jul 06 19:09:53.931136 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.931058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8zv6\" (UniqueName: \"kubernetes.io/projected/7afedb56-59db-4377-a006-5211d46d892d-kube-api-access-r8zv6\") pod \"openshift-lws-operator-fd8ccff4c-h4pdc\" (UID: \"7afedb56-59db-4377-a006-5211d46d892d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" Jul 06 19:09:53.931136 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.931101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afedb56-59db-4377-a006-5211d46d892d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4pdc\" (UID: \"7afedb56-59db-4377-a006-5211d46d892d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" Jul 06 19:09:53.931464 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.931447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afedb56-59db-4377-a006-5211d46d892d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4pdc\" (UID: \"7afedb56-59db-4377-a006-5211d46d892d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" Jul 06 19:09:53.940106 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:53.940087 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8zv6\" (UniqueName: \"kubernetes.io/projected/7afedb56-59db-4377-a006-5211d46d892d-kube-api-access-r8zv6\") pod \"openshift-lws-operator-fd8ccff4c-h4pdc\" (UID: \"7afedb56-59db-4377-a006-5211d46d892d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" Jul 06 19:09:54.000670 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:54.000647 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" Jul 06 19:09:54.121518 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:54.121450 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc"] Jul 06 19:09:54.123727 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:09:54.123701 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7afedb56_59db_4377_a006_5211d46d892d.slice/crio-af65f4dc05fe2e790239daf654b5ed7f18feb40816cbd99fc625745c8a4560f1 WatchSource:0}: Error finding container af65f4dc05fe2e790239daf654b5ed7f18feb40816cbd99fc625745c8a4560f1: Status 404 returned error can't find the container with id af65f4dc05fe2e790239daf654b5ed7f18feb40816cbd99fc625745c8a4560f1 Jul 06 19:09:54.926003 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:54.925961 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" event={"ID":"7afedb56-59db-4377-a006-5211d46d892d","Type":"ContainerStarted","Data":"af65f4dc05fe2e790239daf654b5ed7f18feb40816cbd99fc625745c8a4560f1"} Jul 06 19:09:56.935440 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:56.935355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" event={"ID":"7afedb56-59db-4377-a006-5211d46d892d","Type":"ContainerStarted","Data":"47adb367030522314d92c96b9c26c663a5792b552d7a977c31242dfc369ef7e7"} Jul 06 19:09:56.952226 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:09:56.952173 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4pdc" podStartSLOduration=1.502072562 podStartE2EDuration="3.952148898s" totalImagesPullingTime="2.450076336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:56.951196837 +0000 UTC m=+228.645977499" watchObservedRunningTime="2026-07-06 19:09:56.952148898 +0000 UTC m=+228.646929561" Jul 06 19:10:17.619397 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.619350 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp"] Jul 06 19:10:17.622561 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.622540 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.625127 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625106 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:10:17.625127 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625120 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:10:17.625334 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfbbe097-cb20-4ade-821b-98b7056510b1-tmp\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.625384 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvd2n\" (UniqueName: \"kubernetes.io/projected/cfbbe097-cb20-4ade-821b-98b7056510b1-kube-api-access-nvd2n\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.625430 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625383 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:10:17.625430 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625419 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-59vkn\"" Jul 06 19:10:17.625509 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cfbbe097-cb20-4ade-821b-98b7056510b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.625509 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfbbe097-cb20-4ade-821b-98b7056510b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.625587 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cfbbe097-cb20-4ade-821b-98b7056510b1-manifests\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.625638 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.625612 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:10:17.636402 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.636382 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp"] Jul 06 19:10:17.726407 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.726375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfbbe097-cb20-4ade-821b-98b7056510b1-tmp\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.726567 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.726412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvd2n\" (UniqueName: \"kubernetes.io/projected/cfbbe097-cb20-4ade-821b-98b7056510b1-kube-api-access-nvd2n\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.726567 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.726453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cfbbe097-cb20-4ade-821b-98b7056510b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.726567 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.726483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfbbe097-cb20-4ade-821b-98b7056510b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.726567 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.726544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cfbbe097-cb20-4ade-821b-98b7056510b1-manifests\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.726907 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.726880 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cfbbe097-cb20-4ade-821b-98b7056510b1-manifests\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.728633 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.728601 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfbbe097-cb20-4ade-821b-98b7056510b1-tmp\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.728891 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.728872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cfbbe097-cb20-4ade-821b-98b7056510b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.729104 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.729084 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfbbe097-cb20-4ade-821b-98b7056510b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.737908 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.737888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvd2n\" (UniqueName: \"kubernetes.io/projected/cfbbe097-cb20-4ade-821b-98b7056510b1-kube-api-access-nvd2n\") pod \"opendatahub-operator-controller-manager-7598fdd968-lrfmp\" (UID: \"cfbbe097-cb20-4ade-821b-98b7056510b1\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:17.932791 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:17.932705 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:18.091770 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:18.091749 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp"] Jul 06 19:10:18.093172 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:10:18.093141 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbbe097_cb20_4ade_821b_98b7056510b1.slice/crio-cdf1d17a4b74af4e866e34bbac2c5f8bf1d35b46ce11a6ac73f59077aa78f17a WatchSource:0}: Error finding container cdf1d17a4b74af4e866e34bbac2c5f8bf1d35b46ce11a6ac73f59077aa78f17a: Status 404 returned error can't find the container with id cdf1d17a4b74af4e866e34bbac2c5f8bf1d35b46ce11a6ac73f59077aa78f17a Jul 06 19:10:19.016456 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:19.016409 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" event={"ID":"cfbbe097-cb20-4ade-821b-98b7056510b1","Type":"ContainerStarted","Data":"cdf1d17a4b74af4e866e34bbac2c5f8bf1d35b46ce11a6ac73f59077aa78f17a"} Jul 06 19:10:21.026075 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:21.026039 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" event={"ID":"cfbbe097-cb20-4ade-821b-98b7056510b1","Type":"ContainerStarted","Data":"de0371f1b97ee5c8c23951d6718154db009b8c029f30797f4b57e4ac112df71a"} Jul 06 19:10:22.031580 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:22.031543 2574 generic.go:356] "Generic (PLEG): container finished" podID="cfbbe097-cb20-4ade-821b-98b7056510b1" containerID="de0371f1b97ee5c8c23951d6718154db009b8c029f30797f4b57e4ac112df71a" exitCode=0 Jul 06 19:10:22.031929 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:22.031613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" event={"ID":"cfbbe097-cb20-4ade-821b-98b7056510b1","Type":"ContainerDied","Data":"de0371f1b97ee5c8c23951d6718154db009b8c029f30797f4b57e4ac112df71a"} Jul 06 19:10:23.037104 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:23.037074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" event={"ID":"cfbbe097-cb20-4ade-821b-98b7056510b1","Type":"ContainerStarted","Data":"33203e735004a3108b2af58143f6df3a99d922a511173a7bcc5b61d1e9a901fc"} Jul 06 19:10:23.037687 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:23.037220 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:23.060874 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:23.060696 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" podStartSLOduration=1.891129235 podStartE2EDuration="6.060680264s" totalImagesPullingTime="3.122276145s" totalInitContainerRuntime="1.047274884s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:23.059565876 +0000 UTC m=+254.754346537" watchObservedRunningTime="2026-07-06 19:10:23.060680264 +0000 UTC m=+254.755460923" Jul 06 19:10:34.043336 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:34.043239 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-lrfmp" Jul 06 19:10:36.952996 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:36.952956 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b"] Jul 06 19:10:36.960388 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:36.960364 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:36.963327 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:36.963305 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 19:10:36.964769 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:36.964747 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:10:36.964868 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:36.964782 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:10:36.964868 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:36.964827 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 19:10:36.964868 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:36.964757 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hhbgq\"" Jul 06 19:10:36.977840 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:36.977815 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b"] Jul 06 19:10:37.074655 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.074619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218389c0-6ad1-4970-9add-c2bfc99df803-tls-certs\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.074816 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.074678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/218389c0-6ad1-4970-9add-c2bfc99df803-tmp\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.074816 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.074722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsl5f\" (UniqueName: \"kubernetes.io/projected/218389c0-6ad1-4970-9add-c2bfc99df803-kube-api-access-zsl5f\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.176111 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.176068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/218389c0-6ad1-4970-9add-c2bfc99df803-tmp\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.176111 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.176117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsl5f\" (UniqueName: \"kubernetes.io/projected/218389c0-6ad1-4970-9add-c2bfc99df803-kube-api-access-zsl5f\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.176375 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.176214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218389c0-6ad1-4970-9add-c2bfc99df803-tls-certs\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.178334 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.178305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/218389c0-6ad1-4970-9add-c2bfc99df803-tmp\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.178533 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.178516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218389c0-6ad1-4970-9add-c2bfc99df803-tls-certs\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.187197 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.187174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsl5f\" (UniqueName: \"kubernetes.io/projected/218389c0-6ad1-4970-9add-c2bfc99df803-kube-api-access-zsl5f\") pod \"kube-auth-proxy-7d54fb4f58-wp49b\" (UID: \"218389c0-6ad1-4970-9add-c2bfc99df803\") " pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.269507 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.269473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" Jul 06 19:10:37.393490 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:37.393466 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b"] Jul 06 19:10:37.395995 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:10:37.395968 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218389c0_6ad1_4970_9add_c2bfc99df803.slice/crio-0858f13a0da7cf34915e2694e22ad6fdd20312a9d88974038d9db2d7e5df291f WatchSource:0}: Error finding container 0858f13a0da7cf34915e2694e22ad6fdd20312a9d88974038d9db2d7e5df291f: Status 404 returned error can't find the container with id 0858f13a0da7cf34915e2694e22ad6fdd20312a9d88974038d9db2d7e5df291f Jul 06 19:10:38.094879 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:38.094815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" event={"ID":"218389c0-6ad1-4970-9add-c2bfc99df803","Type":"ContainerStarted","Data":"0858f13a0da7cf34915e2694e22ad6fdd20312a9d88974038d9db2d7e5df291f"} Jul 06 19:10:40.104476 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:40.104385 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" event={"ID":"218389c0-6ad1-4970-9add-c2bfc99df803","Type":"ContainerStarted","Data":"3dae7e25f767b068c5294ef815f29a3d3db13f80e937b2f21f804874c7591ed8"} Jul 06 19:10:40.122680 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:40.122631 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d54fb4f58-wp49b" podStartSLOduration=1.7430753719999998 podStartE2EDuration="4.122615677s" totalImagesPullingTime="2.379540305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:40.121025143 +0000 UTC m=+271.815805831" watchObservedRunningTime="2026-07-06 19:10:40.122615677 +0000 UTC m=+271.817396338" Jul 06 19:10:43.685587 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.685555 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd"] Jul 06 19:10:43.688051 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.688027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.690516 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.690497 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:10:43.690630 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.690573 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rztk4\"" Jul 06 19:10:43.700919 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.700896 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd"] Jul 06 19:10:43.728232 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.728356 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.728356 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn99c\" (UniqueName: \"kubernetes.io/projected/17f0a8cf-aa45-42e4-a384-6008c531e8d7-kube-api-access-vn99c\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.728356 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.728488 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.728527 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.728527 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.728616 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.728616 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.728544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829281 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829458 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829458 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829334 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829458 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829458 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829373 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829458 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829458 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn99c\" (UniqueName: \"kubernetes.io/projected/17f0a8cf-aa45-42e4-a384-6008c531e8d7-kube-api-access-vn99c\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829458 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829437 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829813 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829509 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829911 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829964 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.829964 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.829945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.830116 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.830093 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.830177 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.830141 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.831704 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.831677 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.831911 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.831896 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.840470 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.840450 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f0a8cf-aa45-42e4-a384-6008c531e8d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.843523 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.843506 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn99c\" (UniqueName: \"kubernetes.io/projected/17f0a8cf-aa45-42e4-a384-6008c531e8d7-kube-api-access-vn99c\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785lbmd\" (UID: \"17f0a8cf-aa45-42e4-a384-6008c531e8d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:43.997928 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:43.997902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:44.132978 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:44.132885 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd"] Jul 06 19:10:44.135443 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:10:44.135419 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f0a8cf_aa45_42e4_a384_6008c531e8d7.slice/crio-ef895769b571773edad8fcfbf410ab18dc8d48d089a4f51c89ee803ea9d7eaf3 WatchSource:0}: Error finding container ef895769b571773edad8fcfbf410ab18dc8d48d089a4f51c89ee803ea9d7eaf3: Status 404 returned error can't find the container with id ef895769b571773edad8fcfbf410ab18dc8d48d089a4f51c89ee803ea9d7eaf3 Jul 06 19:10:45.128649 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:45.128602 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" event={"ID":"17f0a8cf-aa45-42e4-a384-6008c531e8d7","Type":"ContainerStarted","Data":"ef895769b571773edad8fcfbf410ab18dc8d48d089a4f51c89ee803ea9d7eaf3"} Jul 06 19:10:46.334331 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.334304 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52"] Jul 06 19:10:46.339302 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.339269 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.342054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.342013 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 19:10:46.342160 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.342086 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nncwp\"" Jul 06 19:10:46.342428 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.342412 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 19:10:46.342758 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.342732 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 19:10:46.354654 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.354625 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52"] Jul 06 19:10:46.381142 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.381108 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7"] Jul 06 19:10:46.383478 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.383460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.387053 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.387032 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vt22n\"" Jul 06 19:10:46.387053 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.387050 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 19:10:46.387193 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.387056 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 19:10:46.387257 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.387188 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 19:10:46.396117 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.396095 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7"] Jul 06 19:10:46.455534 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d90a9194-6a47-4aea-a7af-3edb7590fa78-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.455534 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94d4ac84-cc83-4ece-ab11-1668e868507f-cert\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.455771 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.455771 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9n4v\" (UniqueName: \"kubernetes.io/projected/d90a9194-6a47-4aea-a7af-3edb7590fa78-kube-api-access-q9n4v\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.455771 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94d4ac84-cc83-4ece-ab11-1668e868507f-metrics-cert\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.455913 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.455913 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.455913 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94d4ac84-cc83-4ece-ab11-1668e868507f-manager-config\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.456060 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.456060 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4vc\" (UniqueName: \"kubernetes.io/projected/94d4ac84-cc83-4ece-ab11-1668e868507f-kube-api-access-zf4vc\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.456060 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.455989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.556759 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.556725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d90a9194-6a47-4aea-a7af-3edb7590fa78-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.556759 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.556762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94d4ac84-cc83-4ece-ab11-1668e868507f-cert\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.557007 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.556823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.557007 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.556840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9n4v\" (UniqueName: \"kubernetes.io/projected/d90a9194-6a47-4aea-a7af-3edb7590fa78-kube-api-access-q9n4v\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.557007 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.556863 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94d4ac84-cc83-4ece-ab11-1668e868507f-metrics-cert\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.557007 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.556892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.557007 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.556918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.557253 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.557089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94d4ac84-cc83-4ece-ab11-1668e868507f-manager-config\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.557253 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.557146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.557253 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.557174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4vc\" (UniqueName: \"kubernetes.io/projected/94d4ac84-cc83-4ece-ab11-1668e868507f-kube-api-access-zf4vc\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.557253 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.557207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.558049 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.557965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.558049 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.557966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94d4ac84-cc83-4ece-ab11-1668e868507f-manager-config\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.559782 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.559757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d90a9194-6a47-4aea-a7af-3edb7590fa78-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.560207 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.560180 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94d4ac84-cc83-4ece-ab11-1668e868507f-cert\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.560444 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.560414 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.560552 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.560420 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.560552 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.560529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94d4ac84-cc83-4ece-ab11-1668e868507f-metrics-cert\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.560881 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.560860 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.568691 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.568669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d90a9194-6a47-4aea-a7af-3edb7590fa78-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.568889 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.568864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9n4v\" (UniqueName: \"kubernetes.io/projected/d90a9194-6a47-4aea-a7af-3edb7590fa78-kube-api-access-q9n4v\") pod \"istiod-openshift-gateway-94bb8fbfd-kvf52\" (UID: \"d90a9194-6a47-4aea-a7af-3edb7590fa78\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.569875 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.569851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4vc\" (UniqueName: \"kubernetes.io/projected/94d4ac84-cc83-4ece-ab11-1668e868507f-kube-api-access-zf4vc\") pod \"lws-controller-manager-5d97cd6788-bszr7\" (UID: \"94d4ac84-cc83-4ece-ab11-1668e868507f\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.650197 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.650107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:46.694235 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.694202 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:46.739010 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.738966 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:10:46.739137 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.739064 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:10:46.739137 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.739111 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:10:46.881275 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.881252 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52"] Jul 06 19:10:46.884365 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:10:46.884324 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90a9194_6a47_4aea_a7af_3edb7590fa78.slice/crio-1285c083fa76ed847b021ddfe42cae61f929f4c798088467f900333ce15a4e15 WatchSource:0}: Error finding container 1285c083fa76ed847b021ddfe42cae61f929f4c798088467f900333ce15a4e15: Status 404 returned error can't find the container with id 1285c083fa76ed847b021ddfe42cae61f929f4c798088467f900333ce15a4e15 Jul 06 19:10:46.891097 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:10:46.891069 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d4ac84_cc83_4ece_ab11_1668e868507f.slice/crio-95829077c59bbf1ce5595e28f9322ef2cb92a7ad0fb77dc2015f642b004a8179 WatchSource:0}: Error finding container 95829077c59bbf1ce5595e28f9322ef2cb92a7ad0fb77dc2015f642b004a8179: Status 404 returned error can't find the container with id 95829077c59bbf1ce5595e28f9322ef2cb92a7ad0fb77dc2015f642b004a8179 Jul 06 19:10:46.891624 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:46.891605 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7"] Jul 06 19:10:47.139889 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:47.139854 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" event={"ID":"94d4ac84-cc83-4ece-ab11-1668e868507f","Type":"ContainerStarted","Data":"95829077c59bbf1ce5595e28f9322ef2cb92a7ad0fb77dc2015f642b004a8179"} Jul 06 19:10:47.141729 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:47.141699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" event={"ID":"17f0a8cf-aa45-42e4-a384-6008c531e8d7","Type":"ContainerStarted","Data":"3e4b0dcc13c2fb9ccecbcc353da6d18f2a92db242c4c6c197813da0eba17af21"} Jul 06 19:10:47.143066 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:47.143035 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" event={"ID":"d90a9194-6a47-4aea-a7af-3edb7590fa78","Type":"ContainerStarted","Data":"1285c083fa76ed847b021ddfe42cae61f929f4c798088467f900333ce15a4e15"} Jul 06 19:10:47.998896 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:47.998853 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:48.005118 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:48.005088 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:48.048071 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:48.048013 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" podStartSLOduration=2.446550034 podStartE2EDuration="5.04799341s" totalImagesPullingTime="2.601443376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:47.185555111 +0000 UTC m=+278.880335772" watchObservedRunningTime="2026-07-06 19:10:48.04799341 +0000 UTC m=+279.742774073" Jul 06 19:10:48.148909 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:48.148835 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:48.150102 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:48.150072 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785lbmd" Jul 06 19:10:49.155350 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:49.155315 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" event={"ID":"94d4ac84-cc83-4ece-ab11-1668e868507f","Type":"ContainerStarted","Data":"9bac70577c4dbb65816f95e9fcd1b4f3da86fb326bad4ae78738330ab3c48a01"} Jul 06 19:10:49.155827 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:49.155571 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:10:49.200755 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:49.200702 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" podStartSLOduration=1.708525582 podStartE2EDuration="3.200687592s" totalImagesPullingTime="1.49216201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:49.194505164 +0000 UTC m=+280.889285824" watchObservedRunningTime="2026-07-06 19:10:49.200687592 +0000 UTC m=+280.895468252" Jul 06 19:10:49.412566 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:49.412527 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:10:49.412688 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:49.412617 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:10:50.161152 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:50.161114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" event={"ID":"d90a9194-6a47-4aea-a7af-3edb7590fa78","Type":"ContainerStarted","Data":"80f5847bca290478fa34b76bb32359b4b231a80a362ceb020b3c7d8c5a203c6d"} Jul 06 19:10:50.210362 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:50.210281 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" podStartSLOduration=1.686152058 podStartE2EDuration="4.2102645s" totalImagesPullingTime="2.524112442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:50.208862423 +0000 UTC m=+281.903643085" watchObservedRunningTime="2026-07-06 19:10:50.2102645 +0000 UTC m=+281.905045162" Jul 06 19:10:51.165759 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:51.165727 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:10:51.167483 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:10:51.167457 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kvf52" Jul 06 19:11:00.163537 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:11:00.163508 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-bszr7" Jul 06 19:11:08.769193 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:11:08.769165 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:11:08.769694 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:11:08.769678 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:11:08.773965 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:11:08.773941 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:12:27.847740 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:27.847659 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74775cfcf8-d57jh"] Jul 06 19:12:52.874001 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:52.873931 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74775cfcf8-d57jh" podUID="49b4ee29-3315-4796-8c54-ae9abf049dd3" containerName="console" containerID="cri-o://8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619" gracePeriod=15 Jul 06 19:12:53.119382 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.119358 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:12:53.195406 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195329 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvqjt\" (UniqueName: \"kubernetes.io/projected/49b4ee29-3315-4796-8c54-ae9abf049dd3-kube-api-access-bvqjt\") pod \"49b4ee29-3315-4796-8c54-ae9abf049dd3\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " Jul 06 19:12:53.195406 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195362 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-trusted-ca-bundle\") pod \"49b4ee29-3315-4796-8c54-ae9abf049dd3\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " Jul 06 19:12:53.195406 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195394 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-oauth-config\") pod \"49b4ee29-3315-4796-8c54-ae9abf049dd3\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " Jul 06 19:12:53.195684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195456 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-oauth-serving-cert\") pod \"49b4ee29-3315-4796-8c54-ae9abf049dd3\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " Jul 06 19:12:53.195684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195493 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-serving-cert\") pod \"49b4ee29-3315-4796-8c54-ae9abf049dd3\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " Jul 06 19:12:53.195684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195580 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-service-ca\") pod \"49b4ee29-3315-4796-8c54-ae9abf049dd3\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " Jul 06 19:12:53.195684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195608 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-config\") pod \"49b4ee29-3315-4796-8c54-ae9abf049dd3\" (UID: \"49b4ee29-3315-4796-8c54-ae9abf049dd3\") " Jul 06 19:12:53.195898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195822 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "49b4ee29-3315-4796-8c54-ae9abf049dd3" (UID: "49b4ee29-3315-4796-8c54-ae9abf049dd3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:12:53.195898 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.195830 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "49b4ee29-3315-4796-8c54-ae9abf049dd3" (UID: "49b4ee29-3315-4796-8c54-ae9abf049dd3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:12:53.196075 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.196037 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-service-ca" (OuterVolumeSpecName: "service-ca") pod "49b4ee29-3315-4796-8c54-ae9abf049dd3" (UID: "49b4ee29-3315-4796-8c54-ae9abf049dd3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:12:53.196075 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.196074 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-trusted-ca-bundle\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:12:53.196251 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.196094 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-oauth-serving-cert\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:12:53.196251 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.196093 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-config" (OuterVolumeSpecName: "console-config") pod "49b4ee29-3315-4796-8c54-ae9abf049dd3" (UID: "49b4ee29-3315-4796-8c54-ae9abf049dd3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:12:53.197547 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.197519 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b4ee29-3315-4796-8c54-ae9abf049dd3-kube-api-access-bvqjt" (OuterVolumeSpecName: "kube-api-access-bvqjt") pod "49b4ee29-3315-4796-8c54-ae9abf049dd3" (UID: "49b4ee29-3315-4796-8c54-ae9abf049dd3"). InnerVolumeSpecName "kube-api-access-bvqjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:12:53.197659 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.197619 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "49b4ee29-3315-4796-8c54-ae9abf049dd3" (UID: "49b4ee29-3315-4796-8c54-ae9abf049dd3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:12:53.197979 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.197957 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "49b4ee29-3315-4796-8c54-ae9abf049dd3" (UID: "49b4ee29-3315-4796-8c54-ae9abf049dd3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:12:53.297421 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.297391 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-oauth-config\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:12:53.297421 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.297414 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-serving-cert\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:12:53.297421 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.297423 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-service-ca\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:12:53.297616 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.297432 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49b4ee29-3315-4796-8c54-ae9abf049dd3-console-config\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:12:53.297616 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.297440 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvqjt\" (UniqueName: \"kubernetes.io/projected/49b4ee29-3315-4796-8c54-ae9abf049dd3-kube-api-access-bvqjt\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:12:53.671249 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.671212 2574 generic.go:356] "Generic (PLEG): container finished" podID="49b4ee29-3315-4796-8c54-ae9abf049dd3" containerID="8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619" exitCode=0 Jul 06 19:12:53.671450 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.671259 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74775cfcf8-d57jh" Jul 06 19:12:53.671450 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.671313 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74775cfcf8-d57jh" event={"ID":"49b4ee29-3315-4796-8c54-ae9abf049dd3","Type":"ContainerDied","Data":"8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619"} Jul 06 19:12:53.671450 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.671367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74775cfcf8-d57jh" event={"ID":"49b4ee29-3315-4796-8c54-ae9abf049dd3","Type":"ContainerDied","Data":"937d92db75a17cb29e55b9483958a2c7d3f8318c642c4c9761a47fd4a962e799"} Jul 06 19:12:53.671450 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.671389 2574 scope.go:117] "RemoveContainer" containerID="8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619" Jul 06 19:12:53.679862 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.679843 2574 scope.go:117] "RemoveContainer" containerID="8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619" Jul 06 19:12:53.680101 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:12:53.680083 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619\": container with ID starting with 8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619 not found: ID does not exist" containerID="8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619" Jul 06 19:12:53.680169 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.680127 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619"} err="failed to get container status \"8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619\": rpc error: code = NotFound desc = could not find container \"8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619\": container with ID starting with 8557c7950cdcd3ca96d325f52f4a3a7532493b989cd81d5e8b54351cd08f2619 not found: ID does not exist" Jul 06 19:12:53.701488 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.701465 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74775cfcf8-d57jh"] Jul 06 19:12:53.706873 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:53.706852 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74775cfcf8-d57jh"] Jul 06 19:12:54.889722 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:12:54.889689 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49b4ee29-3315-4796-8c54-ae9abf049dd3" path="/var/lib/kubelet/pods/49b4ee29-3315-4796-8c54-ae9abf049dd3/volumes" Jul 06 19:16:08.796132 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:16:08.796103 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:16:08.796790 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:16:08.796630 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:21:08.822301 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:21:08.822210 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:21:08.823300 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:21:08.823259 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:26:08.847593 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:26:08.847563 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:26:08.848807 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:26:08.848787 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:31:08.874209 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:31:08.874178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:31:08.875414 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:31:08.875397 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:36:08.899054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:36:08.899029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:36:08.901280 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:36:08.901259 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:38:12.998044 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:12.998003 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85"] Jul 06 19:38:12.998544 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:12.998498 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49b4ee29-3315-4796-8c54-ae9abf049dd3" containerName="console" Jul 06 19:38:12.998544 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:12.998513 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="49b4ee29-3315-4796-8c54-ae9abf049dd3" containerName="console" Jul 06 19:38:12.998626 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:12.998565 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="49b4ee29-3315-4796-8c54-ae9abf049dd3" containerName="console" Jul 06 19:38:13.001539 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.001518 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.004123 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.004092 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-8f1080-openshift-default-dockercfg-sgq8d\"" Jul 06 19:38:13.014324 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.014282 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85"] Jul 06 19:38:13.056330 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056299 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-credential-socket\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.056477 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7a2645-b684-4597-9001-85fac5460aaa-istio-podinfo\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.056477 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7a2645-b684-4597-9001-85fac5460aaa-istiod-ca-cert\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.056477 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-data\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.056477 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056471 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-istio-token\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.056649 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-envoy\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.056649 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056574 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-socket\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.056649 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-certs\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.056649 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.056634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gklm2\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-kube-api-access-gklm2\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.157633 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-credential-socket\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.157817 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7a2645-b684-4597-9001-85fac5460aaa-istio-podinfo\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.157817 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7a2645-b684-4597-9001-85fac5460aaa-istiod-ca-cert\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.157817 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-data\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.157817 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-istio-token\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.157817 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-envoy\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.158072 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-socket\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.158072 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-certs\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.158072 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.157896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gklm2\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-kube-api-access-gklm2\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.158252 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.158105 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-credential-socket\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.158252 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.158111 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-data\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.158408 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.158386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-socket\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.158463 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.158426 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-certs\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.158568 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.158547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7a2645-b684-4597-9001-85fac5460aaa-istiod-ca-cert\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.160198 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.160181 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-envoy\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.160330 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.160315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7a2645-b684-4597-9001-85fac5460aaa-istio-podinfo\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.166478 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.166454 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-istio-token\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.166662 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.166645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gklm2\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-kube-api-access-gklm2\") pod \"e2e-api-a-8f1080-openshift-default-794547b4f-t4x85\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.311912 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.311835 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:13.441903 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.441878 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85"] Jul 06 19:38:13.444086 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:38:13.444056 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7a2645_b684_4597_9001_85fac5460aaa.slice/crio-59165ca83e41f2776a0d31c4c2042c4676ecc511ad5a4ad92f6d2c115c1590ca WatchSource:0}: Error finding container 59165ca83e41f2776a0d31c4c2042c4676ecc511ad5a4ad92f6d2c115c1590ca: Status 404 returned error can't find the container with id 59165ca83e41f2776a0d31c4c2042c4676ecc511ad5a4ad92f6d2c115c1590ca Jul 06 19:38:13.446123 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.446090 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:38:13.446176 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.446156 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:38:13.446209 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.446184 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:38:13.975410 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.975370 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" event={"ID":"6c7a2645-b684-4597-9001-85fac5460aaa","Type":"ContainerStarted","Data":"dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8"} Jul 06 19:38:13.975591 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.975424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" event={"ID":"6c7a2645-b684-4597-9001-85fac5460aaa","Type":"ContainerStarted","Data":"59165ca83e41f2776a0d31c4c2042c4676ecc511ad5a4ad92f6d2c115c1590ca"} Jul 06 19:38:13.997582 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:13.997536 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" podStartSLOduration=1.9975209779999998 podStartE2EDuration="1.997520978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:13.996125954 +0000 UTC m=+1925.690906618" watchObservedRunningTime="2026-07-06 19:38:13.997520978 +0000 UTC m=+1925.692301707" Jul 06 19:38:14.312660 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:14.312618 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:14.317653 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:14.317625 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:14.979386 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:14.979352 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:14.980203 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:14.980183 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:30.795778 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:30.795654 2574 patch_prober.go:28] interesting pod/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": read tcp 10.133.0.2:50370->10.133.0.23:15021: read: connection reset by peer" start-of-body= Jul 06 19:38:30.795778 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:30.795718 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": read tcp 10.133.0.2:50370->10.133.0.23:15021: read: connection reset by peer" Jul 06 19:38:31.056106 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:31.056022 2574 generic.go:356] "Generic (PLEG): container finished" podID="6c7a2645-b684-4597-9001-85fac5460aaa" containerID="dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8" exitCode=0 Jul 06 19:38:31.056275 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:31.056104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" event={"ID":"6c7a2645-b684-4597-9001-85fac5460aaa","Type":"ContainerDied","Data":"dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8"} Jul 06 19:38:31.056568 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:31.056553 2574 scope.go:117] "RemoveContainer" containerID="dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8" Jul 06 19:38:31.057500 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:31.057475 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:38:31.057557 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:31.057539 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:38:31.057608 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:31.057595 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 19:38:32.062499 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:32.062460 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" event={"ID":"6c7a2645-b684-4597-9001-85fac5460aaa","Type":"ContainerStarted","Data":"72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827"} Jul 06 19:38:32.312302 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:32.312266 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:32.312659 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:32.312599 2574 patch_prober.go:28] interesting pod/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 06 19:38:32.312719 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:32.312657 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 06 19:38:33.312283 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:33.312247 2574 patch_prober.go:28] interesting pod/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 06 19:38:33.312778 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:33.312328 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 06 19:38:34.313186 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:34.313150 2574 patch_prober.go:28] interesting pod/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 06 19:38:34.313584 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:34.313204 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 06 19:38:35.312710 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:35.312676 2574 patch_prober.go:28] interesting pod/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 06 19:38:35.312894 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:35.312745 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 06 19:38:36.312979 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:36.312945 2574 patch_prober.go:28] interesting pod/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 06 19:38:36.313392 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:36.313001 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 06 19:38:37.316354 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:37.316324 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:37.316719 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:37.316579 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:37.317159 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:37.317141 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:43.748594 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:43.748560 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85"] Jul 06 19:38:43.749157 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:43.748805 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" containerID="cri-o://72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827" gracePeriod=30 Jul 06 19:38:48.984356 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:48.984335 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:49.074940 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.074870 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7a2645-b684-4597-9001-85fac5460aaa-istio-podinfo\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.074940 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.074903 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-credential-socket\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.074940 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.074924 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-certs\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.075187 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.074958 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-istio-token\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.075187 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.074979 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-data\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.075187 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075008 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-envoy\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.075187 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075028 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-socket\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.075187 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075068 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7a2645-b684-4597-9001-85fac5460aaa-istiod-ca-cert\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.075187 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075094 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gklm2\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-kube-api-access-gklm2\") pod \"6c7a2645-b684-4597-9001-85fac5460aaa\" (UID: \"6c7a2645-b684-4597-9001-85fac5460aaa\") " Jul 06 19:38:49.075187 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075169 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:49.075547 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075381 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-credential-socket\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:49.075547 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075378 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:49.075642 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075549 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:49.075692 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075647 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c7a2645-b684-4597-9001-85fac5460aaa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:38:49.076013 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.075987 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:49.077757 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.077731 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c7a2645-b684-4597-9001-85fac5460aaa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:38:49.077757 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.077741 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:49.077870 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.077768 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:38:49.077870 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.077780 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-kube-api-access-gklm2" (OuterVolumeSpecName: "kube-api-access-gklm2") pod "6c7a2645-b684-4597-9001-85fac5460aaa" (UID: "6c7a2645-b684-4597-9001-85fac5460aaa"). InnerVolumeSpecName "kube-api-access-gklm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:49.135731 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.135704 2574 generic.go:356] "Generic (PLEG): container finished" podID="6c7a2645-b684-4597-9001-85fac5460aaa" containerID="72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827" exitCode=0 Jul 06 19:38:49.135825 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.135752 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" Jul 06 19:38:49.135825 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.135787 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" event={"ID":"6c7a2645-b684-4597-9001-85fac5460aaa","Type":"ContainerDied","Data":"72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827"} Jul 06 19:38:49.135895 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.135841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85" event={"ID":"6c7a2645-b684-4597-9001-85fac5460aaa","Type":"ContainerDied","Data":"59165ca83e41f2776a0d31c4c2042c4676ecc511ad5a4ad92f6d2c115c1590ca"} Jul 06 19:38:49.135895 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.135864 2574 scope.go:117] "RemoveContainer" containerID="72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827" Jul 06 19:38:49.144135 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.144119 2574 scope.go:117] "RemoveContainer" containerID="dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8" Jul 06 19:38:49.151364 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.151346 2574 scope.go:117] "RemoveContainer" containerID="72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827" Jul 06 19:38:49.151625 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:38:49.151603 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827\": container with ID starting with 72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827 not found: ID does not exist" containerID="72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827" Jul 06 19:38:49.151684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.151633 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827"} err="failed to get container status \"72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827\": rpc error: code = NotFound desc = could not find container \"72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827\": container with ID starting with 72edb54c054a92ecaf38b6d34a04f1b58a50ce8a84c78f6a23505c0925786827 not found: ID does not exist" Jul 06 19:38:49.151684 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.151648 2574 scope.go:117] "RemoveContainer" containerID="dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8" Jul 06 19:38:49.151896 ip-10-0-141-234 kubenswrapper[2574]: E0706 19:38:49.151881 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8\": container with ID starting with dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8 not found: ID does not exist" containerID="dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8" Jul 06 19:38:49.151934 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.151903 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8"} err="failed to get container status \"dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8\": rpc error: code = NotFound desc = could not find container \"dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8\": container with ID starting with dde17c6bb3159fc3f6c67a9becf6ded7cfb0da24c3120bbcecbf866707f89ec8 not found: ID does not exist" Jul 06 19:38:49.156386 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.156367 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85"] Jul 06 19:38:49.160602 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.160583 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-8f1080-openshift-default-794547b4f-t4x85"] Jul 06 19:38:49.176328 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.176306 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7a2645-b684-4597-9001-85fac5460aaa-istio-podinfo\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:49.176398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.176330 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-certs\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:49.176398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.176340 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-istio-token\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:49.176398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.176349 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-data\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:49.176398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.176357 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-istio-envoy\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:49.176398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.176365 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7a2645-b684-4597-9001-85fac5460aaa-workload-socket\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:49.176398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.176372 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7a2645-b684-4597-9001-85fac5460aaa-istiod-ca-cert\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:49.176398 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:49.176381 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gklm2\" (UniqueName: \"kubernetes.io/projected/6c7a2645-b684-4597-9001-85fac5460aaa-kube-api-access-gklm2\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:38:50.889231 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:38:50.889194 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" path="/var/lib/kubelet/pods/6c7a2645-b684-4597-9001-85fac5460aaa/volumes" Jul 06 19:41:08.922861 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:41:08.922833 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:41:08.925350 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:41:08.925330 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:45:00.141370 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.141277 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4"] Jul 06 19:45:00.141810 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.141588 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" Jul 06 19:45:00.141810 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.141599 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" Jul 06 19:45:00.141810 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.141617 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" Jul 06 19:45:00.141810 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.141622 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" Jul 06 19:45:00.141810 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.141663 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" Jul 06 19:45:00.144446 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.144425 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn"] Jul 06 19:45:00.144634 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.144615 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" Jul 06 19:45:00.144767 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.144749 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7a2645-b684-4597-9001-85fac5460aaa" containerName="istio-proxy" Jul 06 19:45:00.146895 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.146877 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gpd9w\"" Jul 06 19:45:00.146994 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.146880 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 06 19:45:00.147451 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.147435 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq"] Jul 06 19:45:00.147539 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.147524 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" Jul 06 19:45:00.147790 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.147771 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 06 19:45:00.150825 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.150807 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" Jul 06 19:45:00.154489 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.154469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4"] Jul 06 19:45:00.157460 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.157404 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq"] Jul 06 19:45:00.159562 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.159540 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn"] Jul 06 19:45:00.273085 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.273058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxnf\" (UniqueName: \"kubernetes.io/projected/ab11d7e0-8c96-43ff-9922-9d318396f903-kube-api-access-hjxnf\") pod \"maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn\" (UID: \"ab11d7e0-8c96-43ff-9922-9d318396f903\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" Jul 06 19:45:00.273085 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.273088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8t6x\" (UniqueName: \"kubernetes.io/projected/9b9dba76-a3aa-4e0e-9350-c53afd5f9b41-kube-api-access-t8t6x\") pod \"maas-api-key-cleanup-29722785-2qzmq\" (UID: \"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" Jul 06 19:45:00.273278 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.273188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvm7\" (UniqueName: \"kubernetes.io/projected/f5953077-68b5-45a3-980e-68257fb88f5d-kube-api-access-lsvm7\") pod \"maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4\" (UID: \"f5953077-68b5-45a3-980e-68257fb88f5d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" Jul 06 19:45:00.374079 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.374050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxnf\" (UniqueName: \"kubernetes.io/projected/ab11d7e0-8c96-43ff-9922-9d318396f903-kube-api-access-hjxnf\") pod \"maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn\" (UID: \"ab11d7e0-8c96-43ff-9922-9d318396f903\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" Jul 06 19:45:00.374079 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.374082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8t6x\" (UniqueName: \"kubernetes.io/projected/9b9dba76-a3aa-4e0e-9350-c53afd5f9b41-kube-api-access-t8t6x\") pod \"maas-api-key-cleanup-29722785-2qzmq\" (UID: \"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" Jul 06 19:45:00.374264 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.374140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvm7\" (UniqueName: \"kubernetes.io/projected/f5953077-68b5-45a3-980e-68257fb88f5d-kube-api-access-lsvm7\") pod \"maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4\" (UID: \"f5953077-68b5-45a3-980e-68257fb88f5d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" Jul 06 19:45:00.383186 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.383153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvm7\" (UniqueName: \"kubernetes.io/projected/f5953077-68b5-45a3-980e-68257fb88f5d-kube-api-access-lsvm7\") pod \"maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4\" (UID: \"f5953077-68b5-45a3-980e-68257fb88f5d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" Jul 06 19:45:00.383313 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.383237 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8t6x\" (UniqueName: \"kubernetes.io/projected/9b9dba76-a3aa-4e0e-9350-c53afd5f9b41-kube-api-access-t8t6x\") pod \"maas-api-key-cleanup-29722785-2qzmq\" (UID: \"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" Jul 06 19:45:00.383313 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.383256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxnf\" (UniqueName: \"kubernetes.io/projected/ab11d7e0-8c96-43ff-9922-9d318396f903-kube-api-access-hjxnf\") pod \"maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn\" (UID: \"ab11d7e0-8c96-43ff-9922-9d318396f903\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" Jul 06 19:45:00.458369 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.458307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" Jul 06 19:45:00.467038 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.467021 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" Jul 06 19:45:00.474913 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.474874 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" Jul 06 19:45:00.607913 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.607789 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4"] Jul 06 19:45:00.610815 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:45:00.610788 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5953077_68b5_45a3_980e_68257fb88f5d.slice/crio-f170416216f3443518d6e5ac7b0a89d986dff3a3440dfceca5aa4629b2437ece WatchSource:0}: Error finding container f170416216f3443518d6e5ac7b0a89d986dff3a3440dfceca5aa4629b2437ece: Status 404 returned error can't find the container with id f170416216f3443518d6e5ac7b0a89d986dff3a3440dfceca5aa4629b2437ece Jul 06 19:45:00.612942 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.612927 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:45:00.689350 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.689323 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" event={"ID":"f5953077-68b5-45a3-980e-68257fb88f5d","Type":"ContainerStarted","Data":"f170416216f3443518d6e5ac7b0a89d986dff3a3440dfceca5aa4629b2437ece"} Jul 06 19:45:00.838932 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.838909 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn"] Jul 06 19:45:00.842081 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:00.842055 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq"] Jul 06 19:45:00.842368 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:45:00.842338 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab11d7e0_8c96_43ff_9922_9d318396f903.slice/crio-c34e19ab17a7d5c160549d75b576a0ee81d711d722ca930f25f5879cb7e87461 WatchSource:0}: Error finding container c34e19ab17a7d5c160549d75b576a0ee81d711d722ca930f25f5879cb7e87461: Status 404 returned error can't find the container with id c34e19ab17a7d5c160549d75b576a0ee81d711d722ca930f25f5879cb7e87461 Jul 06 19:45:00.844808 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:45:00.844788 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9dba76_a3aa_4e0e_9350_c53afd5f9b41.slice/crio-05791cb2ef97941544b55ffe51318233be7bba778ee7a37e4d6630075720b636 WatchSource:0}: Error finding container 05791cb2ef97941544b55ffe51318233be7bba778ee7a37e4d6630075720b636: Status 404 returned error can't find the container with id 05791cb2ef97941544b55ffe51318233be7bba778ee7a37e4d6630075720b636 Jul 06 19:45:01.698464 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:01.698367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" event={"ID":"ab11d7e0-8c96-43ff-9922-9d318396f903","Type":"ContainerStarted","Data":"c34e19ab17a7d5c160549d75b576a0ee81d711d722ca930f25f5879cb7e87461"} Jul 06 19:45:01.700650 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:01.700576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" event={"ID":"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41","Type":"ContainerStarted","Data":"05791cb2ef97941544b55ffe51318233be7bba778ee7a37e4d6630075720b636"} Jul 06 19:45:03.711582 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:03.711546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" event={"ID":"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41","Type":"ContainerStarted","Data":"850c0abccc14fe57263adfc9ad42d95be96b8dbb64a4af51240a9bbd9f679d9e"} Jul 06 19:45:03.712989 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:03.712962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" event={"ID":"f5953077-68b5-45a3-980e-68257fb88f5d","Type":"ContainerStarted","Data":"7d10ebf13172d64da65ad915b4158cbf79324ccc338e3e6e593b1ecc25497a00"} Jul 06 19:45:03.714258 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:03.714236 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" event={"ID":"ab11d7e0-8c96-43ff-9922-9d318396f903","Type":"ContainerStarted","Data":"97b8e91ebb2ec1cac0c2c5054d38668ccd1fd1bf3912f1e0397c256e0f7dd85b"} Jul 06 19:45:03.732385 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:03.732341 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" podStartSLOduration=1.640644008 podStartE2EDuration="3.732327764s" totalImagesPullingTime="2.091683756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.730455999 +0000 UTC m=+2335.425236670" watchObservedRunningTime="2026-07-06 19:45:03.732327764 +0000 UTC m=+2335.427108424" Jul 06 19:45:03.773579 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:03.773523 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" podStartSLOduration=1.4487169500000001 podStartE2EDuration="3.77350424s" totalImagesPullingTime="2.32478729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.77301032 +0000 UTC m=+2335.467791004" watchObservedRunningTime="2026-07-06 19:45:03.77350424 +0000 UTC m=+2335.468284902" Jul 06 19:45:03.775005 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:03.774956 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" podStartSLOduration=1.676907134 podStartE2EDuration="3.77494337s" totalImagesPullingTime="2.098036236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.756587962 +0000 UTC m=+2335.451368622" watchObservedRunningTime="2026-07-06 19:45:03.77494337 +0000 UTC m=+2335.469724032" Jul 06 19:45:18.777379 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:18.777343 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4"] Jul 06 19:45:18.777848 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:18.777541 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" podUID="f5953077-68b5-45a3-980e-68257fb88f5d" containerName="cleanup" containerID="cri-o://7d10ebf13172d64da65ad915b4158cbf79324ccc338e3e6e593b1ecc25497a00" gracePeriod=30 Jul 06 19:45:48.912059 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:48.912025 2574 generic.go:356] "Generic (PLEG): container finished" podID="f5953077-68b5-45a3-980e-68257fb88f5d" containerID="7d10ebf13172d64da65ad915b4158cbf79324ccc338e3e6e593b1ecc25497a00" exitCode=137 Jul 06 19:45:48.912570 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:48.912103 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" event={"ID":"f5953077-68b5-45a3-980e-68257fb88f5d","Type":"ContainerDied","Data":"7d10ebf13172d64da65ad915b4158cbf79324ccc338e3e6e593b1ecc25497a00"} Jul 06 19:45:48.946954 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:48.946933 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" Jul 06 19:45:49.107989 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:49.107908 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsvm7\" (UniqueName: \"kubernetes.io/projected/f5953077-68b5-45a3-980e-68257fb88f5d-kube-api-access-lsvm7\") pod \"f5953077-68b5-45a3-980e-68257fb88f5d\" (UID: \"f5953077-68b5-45a3-980e-68257fb88f5d\") " Jul 06 19:45:49.110017 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:49.109996 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5953077-68b5-45a3-980e-68257fb88f5d-kube-api-access-lsvm7" (OuterVolumeSpecName: "kube-api-access-lsvm7") pod "f5953077-68b5-45a3-980e-68257fb88f5d" (UID: "f5953077-68b5-45a3-980e-68257fb88f5d"). InnerVolumeSpecName "kube-api-access-lsvm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:49.208953 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:49.208904 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsvm7\" (UniqueName: \"kubernetes.io/projected/f5953077-68b5-45a3-980e-68257fb88f5d-kube-api-access-lsvm7\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:45:49.917066 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:49.917030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" event={"ID":"f5953077-68b5-45a3-980e-68257fb88f5d","Type":"ContainerDied","Data":"f170416216f3443518d6e5ac7b0a89d986dff3a3440dfceca5aa4629b2437ece"} Jul 06 19:45:49.917512 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:49.917081 2574 scope.go:117] "RemoveContainer" containerID="7d10ebf13172d64da65ad915b4158cbf79324ccc338e3e6e593b1ecc25497a00" Jul 06 19:45:49.917512 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:49.917041 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4" Jul 06 19:45:49.943686 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:49.943656 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4"] Jul 06 19:45:49.949383 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:49.949362 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f969f4-29722785-bnjt4"] Jul 06 19:45:50.889051 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:45:50.889001 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5953077-68b5-45a3-980e-68257fb88f5d" path="/var/lib/kubelet/pods/f5953077-68b5-45a3-980e-68257fb88f5d/volumes" Jul 06 19:46:00.010123 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:00.010090 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq"] Jul 06 19:46:00.010853 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:00.010311 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" podUID="9b9dba76-a3aa-4e0e-9350-c53afd5f9b41" containerName="cleanup" containerID="cri-o://850c0abccc14fe57263adfc9ad42d95be96b8dbb64a4af51240a9bbd9f679d9e" gracePeriod=30 Jul 06 19:46:00.012438 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:00.012418 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn"] Jul 06 19:46:00.012589 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:00.012571 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" podUID="ab11d7e0-8c96-43ff-9922-9d318396f903" containerName="cleanup" containerID="cri-o://97b8e91ebb2ec1cac0c2c5054d38668ccd1fd1bf3912f1e0397c256e0f7dd85b" gracePeriod=30 Jul 06 19:46:08.948721 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:08.948693 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:46:08.951242 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:08.951224 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224lr_43be5139-6ef1-42e8-90fb-757c0c8dea14/ovn-acl-logging/0.log" Jul 06 19:46:14.022829 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:14.022797 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7598fdd968-lrfmp_cfbbe097-cb20-4ade-821b-98b7056510b1/copy-manifests/0.log" Jul 06 19:46:14.031437 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:14.031415 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7598fdd968-lrfmp_cfbbe097-cb20-4ade-821b-98b7056510b1/manager/0.log" Jul 06 19:46:16.563723 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:16.563693 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785lbmd_17f0a8cf-aa45-42e4-a384-6008c531e8d7/istio-proxy/0.log" Jul 06 19:46:16.692231 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:16.692203 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kvf52_d90a9194-6a47-4aea-a7af-3edb7590fa78/discovery/0.log" Jul 06 19:46:16.927335 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:16.927241 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d54fb4f58-wp49b_218389c0-6ad1-4970-9add-c2bfc99df803/kube-auth-proxy/0.log" Jul 06 19:46:25.796802 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:25.796760 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ph444_137e73ff-87f0-44f7-aa8d-f7673d57fd4e/global-pull-secret-syncer/0.log" Jul 06 19:46:25.883379 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:25.883354 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dft7p_0a91b2b1-8ec6-4889-ac94-bb55e25391f6/konnectivity-agent/0.log" Jul 06 19:46:26.011237 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:26.011208 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-234.ec2.internal_4771f7106329cec29c4726005550184b/haproxy/0.log" Jul 06 19:46:30.091240 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.091208 2574 generic.go:356] "Generic (PLEG): container finished" podID="ab11d7e0-8c96-43ff-9922-9d318396f903" containerID="97b8e91ebb2ec1cac0c2c5054d38668ccd1fd1bf3912f1e0397c256e0f7dd85b" exitCode=137 Jul 06 19:46:30.091645 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.091271 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" event={"ID":"ab11d7e0-8c96-43ff-9922-9d318396f903","Type":"ContainerDied","Data":"97b8e91ebb2ec1cac0c2c5054d38668ccd1fd1bf3912f1e0397c256e0f7dd85b"} Jul 06 19:46:30.094595 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.093328 2574 generic.go:356] "Generic (PLEG): container finished" podID="9b9dba76-a3aa-4e0e-9350-c53afd5f9b41" containerID="850c0abccc14fe57263adfc9ad42d95be96b8dbb64a4af51240a9bbd9f679d9e" exitCode=137 Jul 06 19:46:30.094595 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.093377 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" event={"ID":"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41","Type":"ContainerDied","Data":"850c0abccc14fe57263adfc9ad42d95be96b8dbb64a4af51240a9bbd9f679d9e"} Jul 06 19:46:30.199916 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.199888 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" Jul 06 19:46:30.230633 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.230606 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" Jul 06 19:46:30.370911 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.370827 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjxnf\" (UniqueName: \"kubernetes.io/projected/ab11d7e0-8c96-43ff-9922-9d318396f903-kube-api-access-hjxnf\") pod \"ab11d7e0-8c96-43ff-9922-9d318396f903\" (UID: \"ab11d7e0-8c96-43ff-9922-9d318396f903\") " Jul 06 19:46:30.370911 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.370878 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8t6x\" (UniqueName: \"kubernetes.io/projected/9b9dba76-a3aa-4e0e-9350-c53afd5f9b41-kube-api-access-t8t6x\") pod \"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41\" (UID: \"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41\") " Jul 06 19:46:30.372816 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.372789 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab11d7e0-8c96-43ff-9922-9d318396f903-kube-api-access-hjxnf" (OuterVolumeSpecName: "kube-api-access-hjxnf") pod "ab11d7e0-8c96-43ff-9922-9d318396f903" (UID: "ab11d7e0-8c96-43ff-9922-9d318396f903"). InnerVolumeSpecName "kube-api-access-hjxnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:46:30.372914 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.372891 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b9dba76-a3aa-4e0e-9350-c53afd5f9b41-kube-api-access-t8t6x" (OuterVolumeSpecName: "kube-api-access-t8t6x") pod "9b9dba76-a3aa-4e0e-9350-c53afd5f9b41" (UID: "9b9dba76-a3aa-4e0e-9350-c53afd5f9b41"). InnerVolumeSpecName "kube-api-access-t8t6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:46:30.471818 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.471791 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjxnf\" (UniqueName: \"kubernetes.io/projected/ab11d7e0-8c96-43ff-9922-9d318396f903-kube-api-access-hjxnf\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:46:30.471818 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:30.471813 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8t6x\" (UniqueName: \"kubernetes.io/projected/9b9dba76-a3aa-4e0e-9350-c53afd5f9b41-kube-api-access-t8t6x\") on node \"ip-10-0-141-234.ec2.internal\" DevicePath \"\"" Jul 06 19:46:31.098478 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.098448 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" Jul 06 19:46:31.098478 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.098468 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn" event={"ID":"ab11d7e0-8c96-43ff-9922-9d318396f903","Type":"ContainerDied","Data":"c34e19ab17a7d5c160549d75b576a0ee81d711d722ca930f25f5879cb7e87461"} Jul 06 19:46:31.098960 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.098536 2574 scope.go:117] "RemoveContainer" containerID="97b8e91ebb2ec1cac0c2c5054d38668ccd1fd1bf3912f1e0397c256e0f7dd85b" Jul 06 19:46:31.099867 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.099837 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" Jul 06 19:46:31.099867 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.099842 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq" event={"ID":"9b9dba76-a3aa-4e0e-9350-c53afd5f9b41","Type":"ContainerDied","Data":"05791cb2ef97941544b55ffe51318233be7bba778ee7a37e4d6630075720b636"} Jul 06 19:46:31.106726 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.106710 2574 scope.go:117] "RemoveContainer" containerID="850c0abccc14fe57263adfc9ad42d95be96b8dbb64a4af51240a9bbd9f679d9e" Jul 06 19:46:31.115460 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.115439 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn"] Jul 06 19:46:31.119903 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.119884 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f31ab4-29722785-f8fkn"] Jul 06 19:46:31.130495 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.130475 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq"] Jul 06 19:46:31.134721 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:31.134702 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722785-2qzmq"] Jul 06 19:46:32.690225 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.690199 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a80901b6-7de1-4382-ad1c-68f8079a7b7e/alertmanager/0.log" Jul 06 19:46:32.717166 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.717117 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a80901b6-7de1-4382-ad1c-68f8079a7b7e/config-reloader/0.log" Jul 06 19:46:32.744578 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.744557 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a80901b6-7de1-4382-ad1c-68f8079a7b7e/kube-rbac-proxy-web/0.log" Jul 06 19:46:32.767199 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.767180 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a80901b6-7de1-4382-ad1c-68f8079a7b7e/kube-rbac-proxy/0.log" Jul 06 19:46:32.796656 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.796622 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a80901b6-7de1-4382-ad1c-68f8079a7b7e/kube-rbac-proxy-metric/0.log" Jul 06 19:46:32.823028 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.823002 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a80901b6-7de1-4382-ad1c-68f8079a7b7e/prom-label-proxy/0.log" Jul 06 19:46:32.855911 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.855847 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a80901b6-7de1-4382-ad1c-68f8079a7b7e/init-config-reloader/0.log" Jul 06 19:46:32.894044 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.894014 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b9dba76-a3aa-4e0e-9350-c53afd5f9b41" path="/var/lib/kubelet/pods/9b9dba76-a3aa-4e0e-9350-c53afd5f9b41/volumes" Jul 06 19:46:32.894374 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.894359 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab11d7e0-8c96-43ff-9922-9d318396f903" path="/var/lib/kubelet/pods/ab11d7e0-8c96-43ff-9922-9d318396f903/volumes" Jul 06 19:46:32.925852 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.925828 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-qkqhg_0a749e55-c27b-4f99-8503-a7650cd4faa7/kube-state-metrics/0.log" Jul 06 19:46:32.945374 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.945355 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-qkqhg_0a749e55-c27b-4f99-8503-a7650cd4faa7/kube-rbac-proxy-main/0.log" Jul 06 19:46:32.968172 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.968134 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-qkqhg_0a749e55-c27b-4f99-8503-a7650cd4faa7/kube-rbac-proxy-self/0.log" Jul 06 19:46:32.999116 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:32.999094 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f5b6667c8-kljwc_70630e5e-c969-4996-9a78-ac92a5bc5b15/metrics-server/0.log" Jul 06 19:46:33.233162 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.233138 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t845b_93ff868a-f770-429a-b1a8-4ca3f11aee1f/node-exporter/0.log" Jul 06 19:46:33.256039 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.255997 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t845b_93ff868a-f770-429a-b1a8-4ca3f11aee1f/kube-rbac-proxy/0.log" Jul 06 19:46:33.279633 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.279610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t845b_93ff868a-f770-429a-b1a8-4ca3f11aee1f/init-textfile/0.log" Jul 06 19:46:33.431343 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.431314 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbccfd8d-8bcb-46df-bf8c-e36297c73cdc/prometheus/0.log" Jul 06 19:46:33.455834 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.455808 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbccfd8d-8bcb-46df-bf8c-e36297c73cdc/config-reloader/0.log" Jul 06 19:46:33.485110 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.485059 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbccfd8d-8bcb-46df-bf8c-e36297c73cdc/thanos-sidecar/0.log" Jul 06 19:46:33.510547 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.510529 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbccfd8d-8bcb-46df-bf8c-e36297c73cdc/kube-rbac-proxy-web/0.log" Jul 06 19:46:33.534128 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.534110 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbccfd8d-8bcb-46df-bf8c-e36297c73cdc/kube-rbac-proxy/0.log" Jul 06 19:46:33.559128 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.559092 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbccfd8d-8bcb-46df-bf8c-e36297c73cdc/kube-rbac-proxy-thanos/0.log" Jul 06 19:46:33.589692 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:33.589673 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbccfd8d-8bcb-46df-bf8c-e36297c73cdc/init-config-reloader/0.log" Jul 06 19:46:35.371687 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.371660 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t"] Jul 06 19:46:35.372054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.371955 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab11d7e0-8c96-43ff-9922-9d318396f903" containerName="cleanup" Jul 06 19:46:35.372054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.371965 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab11d7e0-8c96-43ff-9922-9d318396f903" containerName="cleanup" Jul 06 19:46:35.372054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.371977 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b9dba76-a3aa-4e0e-9350-c53afd5f9b41" containerName="cleanup" Jul 06 19:46:35.372054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.371983 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b9dba76-a3aa-4e0e-9350-c53afd5f9b41" containerName="cleanup" Jul 06 19:46:35.372054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.371996 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5953077-68b5-45a3-980e-68257fb88f5d" containerName="cleanup" Jul 06 19:46:35.372054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.372002 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5953077-68b5-45a3-980e-68257fb88f5d" containerName="cleanup" Jul 06 19:46:35.372054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.372049 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab11d7e0-8c96-43ff-9922-9d318396f903" containerName="cleanup" Jul 06 19:46:35.372054 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.372058 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5953077-68b5-45a3-980e-68257fb88f5d" containerName="cleanup" Jul 06 19:46:35.372308 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.372065 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b9dba76-a3aa-4e0e-9350-c53afd5f9b41" containerName="cleanup" Jul 06 19:46:35.376248 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.376230 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.378965 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.378947 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts2hx\"/\"kube-root-ca.crt\"" Jul 06 19:46:35.379225 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.379209 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts2hx\"/\"openshift-service-ca.crt\"" Jul 06 19:46:35.379336 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.379243 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ts2hx\"/\"default-dockercfg-pfx6k\"" Jul 06 19:46:35.389165 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.389145 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t"] Jul 06 19:46:35.515960 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.515932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-proc\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.516109 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.515975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-sys\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.516109 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.515999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-podres\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.516109 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.516066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-lib-modules\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.516210 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.516117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8kvp\" (UniqueName: \"kubernetes.io/projected/42fbe7ce-8082-4418-9211-e8a79328befc-kube-api-access-z8kvp\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.616715 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-sys\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.616715 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-podres\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.616899 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-lib-modules\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.616899 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8kvp\" (UniqueName: \"kubernetes.io/projected/42fbe7ce-8082-4418-9211-e8a79328befc-kube-api-access-z8kvp\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.616899 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-sys\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.616899 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616870 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-podres\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.617033 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-lib-modules\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.617033 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-proc\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.617033 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.616992 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42fbe7ce-8082-4418-9211-e8a79328befc-proc\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.628204 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.628153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8kvp\" (UniqueName: \"kubernetes.io/projected/42fbe7ce-8082-4418-9211-e8a79328befc-kube-api-access-z8kvp\") pod \"perf-node-gather-daemonset-7qk9t\" (UID: \"42fbe7ce-8082-4418-9211-e8a79328befc\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.686495 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.686470 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:35.818970 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:35.818932 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t"] Jul 06 19:46:35.821259 ip-10-0-141-234 kubenswrapper[2574]: W0706 19:46:35.821228 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod42fbe7ce_8082_4418_9211_e8a79328befc.slice/crio-110b33e28999f2fb20cd9e71d65e4da193be7466fc189dda17bbcf4a266ae4a4 WatchSource:0}: Error finding container 110b33e28999f2fb20cd9e71d65e4da193be7466fc189dda17bbcf4a266ae4a4: Status 404 returned error can't find the container with id 110b33e28999f2fb20cd9e71d65e4da193be7466fc189dda17bbcf4a266ae4a4 Jul 06 19:46:36.125233 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:36.125204 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" event={"ID":"42fbe7ce-8082-4418-9211-e8a79328befc","Type":"ContainerStarted","Data":"0467a3ec653902b3a6bbd449f47d1c165757b5dadf2051303cc16610b86a5c6c"} Jul 06 19:46:36.125411 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:36.125253 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" event={"ID":"42fbe7ce-8082-4418-9211-e8a79328befc","Type":"ContainerStarted","Data":"110b33e28999f2fb20cd9e71d65e4da193be7466fc189dda17bbcf4a266ae4a4"} Jul 06 19:46:36.125411 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:36.125302 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:38.086272 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:38.086240 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kfdsp_259905ca-41bf-468b-a876-e86071d1dbb3/dns/0.log" Jul 06 19:46:38.119886 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:38.119864 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kfdsp_259905ca-41bf-468b-a876-e86071d1dbb3/kube-rbac-proxy/0.log" Jul 06 19:46:38.227663 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:38.227637 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f2xlb_114a3f97-469a-44f1-b181-fd4d01cdf4f0/dns-node-resolver/0.log" Jul 06 19:46:38.836720 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:38.836685 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c8fc68c48-jqflb_cc5f164e-8559-4875-8e79-7cc2b80d61ab/registry/0.log" Jul 06 19:46:38.865482 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:38.865442 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s2sfd_fc6d584f-d9b6-4ae6-a8d4-1312645c44ba/node-ca/0.log" Jul 06 19:46:40.021513 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:40.021461 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785lbmd_17f0a8cf-aa45-42e4-a384-6008c531e8d7/istio-proxy/0.log" Jul 06 19:46:40.128578 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:40.128550 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kvf52_d90a9194-6a47-4aea-a7af-3edb7590fa78/discovery/0.log" Jul 06 19:46:40.180920 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:40.180887 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d54fb4f58-wp49b_218389c0-6ad1-4970-9add-c2bfc99df803/kube-auth-proxy/0.log" Jul 06 19:46:41.087154 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:41.087127 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jcvmg_3f60d132-8e4b-4ebc-b39b-f648b57ba6de/serve-healthcheck-canary/0.log" Jul 06 19:46:41.676210 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:41.676181 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdzmv_7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8/kube-rbac-proxy/0.log" Jul 06 19:46:41.699607 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:41.699581 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdzmv_7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8/exporter/0.log" Jul 06 19:46:41.721900 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:41.721880 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdzmv_7dbd9738-bf1b-4278-b5ba-e0f1f4ea8dc8/extractor/0.log" Jul 06 19:46:42.139101 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:42.139074 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" Jul 06 19:46:42.158777 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:42.158728 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-7qk9t" podStartSLOduration=7.158712632 podStartE2EDuration="7.158712632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:36.154903921 +0000 UTC m=+2427.849684584" watchObservedRunningTime="2026-07-06 19:46:42.158712632 +0000 UTC m=+2433.853493292" Jul 06 19:46:44.604428 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:44.604399 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7598fdd968-lrfmp_cfbbe097-cb20-4ade-821b-98b7056510b1/manager/0.log" Jul 06 19:46:44.635474 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:44.635446 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7598fdd968-lrfmp_cfbbe097-cb20-4ade-821b-98b7056510b1/copy-manifests/0.log" Jul 06 19:46:45.341529 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:45.341501 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785lbmd_17f0a8cf-aa45-42e4-a384-6008c531e8d7/istio-proxy/0.log" Jul 06 19:46:45.449362 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:45.449263 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kvf52_d90a9194-6a47-4aea-a7af-3edb7590fa78/discovery/0.log" Jul 06 19:46:45.487419 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:45.487394 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d54fb4f58-wp49b_218389c0-6ad1-4970-9add-c2bfc99df803/kube-auth-proxy/0.log" Jul 06 19:46:46.091026 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:46.090999 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d97cd6788-bszr7_94d4ac84-cc83-4ece-ab11-1668e868507f/manager/0.log" Jul 06 19:46:46.168790 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:46.168760 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h4pdc_7afedb56-59db-4377-a006-5211d46d892d/openshift-lws-operator/0.log" Jul 06 19:46:46.815907 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:46.815867 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785lbmd_17f0a8cf-aa45-42e4-a384-6008c531e8d7/istio-proxy/0.log" Jul 06 19:46:46.921934 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:46.921902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kvf52_d90a9194-6a47-4aea-a7af-3edb7590fa78/discovery/0.log" Jul 06 19:46:46.953940 ip-10-0-141-234 kubenswrapper[2574]: I0706 19:46:46.953915 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d54fb4f58-wp49b_218389c0-6ad1-4970-9add-c2bfc99df803/kube-auth-proxy/0.log"