Sep 13 19:03:50.405967 ip-10-0-129-197 systemd[1]: Starting Kubernetes Kubelet... Sep 13 19:03:50.848560 ip-10-0-129-197 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 19:03:50.848560 ip-10-0-129-197 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 13 19:03:50.848560 ip-10-0-129-197 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 19:03:50.848560 ip-10-0-129-197 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 13 19:03:50.848560 ip-10-0-129-197 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 19:03:50.850522 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.850443 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 13 19:03:50.855808 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855791 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855809 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855815 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855819 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855823 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855826 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855829 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855832 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855835 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855837 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855840 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855843 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855847 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855850 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855852 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855855 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:03:50.855849 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855858 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855861 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855864 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855867 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855870 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855872 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855875 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855877 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855880 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855882 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855885 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855888 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855890 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855893 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855895 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855898 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855900 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855904 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855906 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855909 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:03:50.856246 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855913 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855915 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855918 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855920 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855923 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855925 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855928 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855930 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855933 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855935 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855938 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855941 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855943 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855946 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855949 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855952 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855954 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855957 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855960 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855962 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:03:50.856749 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855965 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855967 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855970 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855973 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855977 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855979 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855982 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855984 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855987 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855989 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855993 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.855996 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856000 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856004 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856007 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856010 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856013 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856016 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856019 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:03:50.857351 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856021 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856024 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856027 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856030 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856033 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856037 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856039 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856042 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856045 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856048 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856050 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856053 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856055 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856058 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856061 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856063 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856066 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856069 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856071 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:03:50.858127 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856074 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856076 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856079 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856082 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856085 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856804 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856813 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856816 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856819 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856822 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856825 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856830 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856834 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856837 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856840 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856843 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856847 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856850 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856852 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:03:50.858611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856855 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856859 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856863 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856866 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856869 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856872 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856875 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856877 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856880 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856882 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856885 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856888 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856890 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856893 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856895 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856898 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856901 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856905 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856907 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856910 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:03:50.859109 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856913 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856915 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856918 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856920 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856923 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856926 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856928 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856931 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856933 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856936 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856939 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856941 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856944 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856947 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856950 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856955 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856957 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856960 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856962 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:03:50.859602 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856965 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856968 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856970 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856973 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856975 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856978 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856981 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856983 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856986 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856988 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856991 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856994 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.856997 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857000 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857003 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857006 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857008 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857011 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857014 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857016 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:03:50.860084 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857019 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857022 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857024 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857286 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857306 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857311 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857315 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857320 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857325 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857329 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857335 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857339 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857344 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857348 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857353 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857362 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857367 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857372 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857379 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:03:50.860585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857385 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857390 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857395 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857401 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857406 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857411 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.857416 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858463 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858474 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858478 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858481 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858484 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858487 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858490 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858493 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858495 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858498 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858500 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858505 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:03:50.861074 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858509 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858513 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858516 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858519 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858522 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858525 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858527 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858530 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858532 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858535 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858537 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858540 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858543 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858546 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858548 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858551 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858554 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858557 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858559 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858565 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:03:50.861567 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858567 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858571 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858574 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858577 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858579 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858582 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858585 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858587 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858590 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858594 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858597 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858600 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858602 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858605 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858608 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858610 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858613 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858616 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858619 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858622 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:03:50.862081 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858624 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858627 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858630 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858632 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858635 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858637 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858640 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858643 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858645 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858648 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858651 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858653 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858657 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858659 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858662 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858665 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858667 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858670 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858673 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858675 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:03:50.862574 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858691 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858693 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858696 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858699 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858701 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858704 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858706 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858709 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858712 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858716 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858718 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858725 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858728 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858731 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858733 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858736 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858738 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858743 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858747 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:03:50.863102 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858750 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858753 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858756 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858759 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858762 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858765 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858768 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.858771 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858844 2555 flags.go:64] FLAG: --address="0.0.0.0" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858881 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858887 2555 flags.go:64] FLAG: --anonymous-auth="true" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858891 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858895 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858898 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858907 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858911 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858914 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858917 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858920 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858923 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858927 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858929 2555 flags.go:64] FLAG: --cgroup-root="" Sep 13 19:03:50.863572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858932 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858935 2555 flags.go:64] FLAG: --client-ca-file="" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858939 2555 flags.go:64] FLAG: --cloud-provider="external" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858942 2555 flags.go:64] FLAG: --cluster-dns="[]" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858947 2555 flags.go:64] FLAG: --cluster-domain="" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858950 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858953 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858956 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858960 2555 flags.go:64] FLAG: --container-log-max-files="5" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858968 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858971 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858974 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858978 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858981 2555 flags.go:64] FLAG: --contention-profiling="false" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858984 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858987 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858991 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858994 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.858998 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859001 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859004 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859006 2555 flags.go:64] FLAG: --enable-load-reader="false" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859010 2555 flags.go:64] FLAG: --enable-server="true" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859013 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859017 2555 flags.go:64] FLAG: --event-burst="100" Sep 13 19:03:50.864113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859020 2555 flags.go:64] FLAG: --event-qps="50" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859023 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859027 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859029 2555 flags.go:64] FLAG: --eviction-hard="" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859033 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859036 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859039 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859043 2555 flags.go:64] FLAG: --eviction-soft="" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859045 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859048 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859051 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859054 2555 flags.go:64] FLAG: --experimental-mounter-path="" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859057 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859060 2555 flags.go:64] FLAG: --fail-swap-on="true" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859063 2555 flags.go:64] FLAG: --feature-gates="" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859067 2555 flags.go:64] FLAG: --file-check-frequency="20s" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859070 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859073 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859076 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859078 2555 flags.go:64] FLAG: --healthz-port="10248" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859082 2555 flags.go:64] FLAG: --help="false" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859085 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-129-197.ec2.internal" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859088 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859092 2555 flags.go:64] FLAG: --http-check-frequency="20s" Sep 13 19:03:50.864778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859095 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859099 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859102 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859105 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859108 2555 flags.go:64] FLAG: --image-service-endpoint="" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859111 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859114 2555 flags.go:64] FLAG: --kube-api-burst="100" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859117 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859121 2555 flags.go:64] FLAG: --kube-api-qps="50" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859124 2555 flags.go:64] FLAG: --kube-reserved="" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859127 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859130 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859133 2555 flags.go:64] FLAG: --kubelet-cgroups="" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859136 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859139 2555 flags.go:64] FLAG: --lock-file="" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859142 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859145 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859148 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859153 2555 flags.go:64] FLAG: --log-json-split-stream="false" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859156 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859159 2555 flags.go:64] FLAG: --log-text-split-stream="false" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859162 2555 flags.go:64] FLAG: --logging-format="text" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859165 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859168 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 13 19:03:50.865383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859171 2555 flags.go:64] FLAG: --manifest-url="" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859174 2555 flags.go:64] FLAG: --manifest-url-header="" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859178 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859181 2555 flags.go:64] FLAG: --max-open-files="1000000" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859185 2555 flags.go:64] FLAG: --max-pods="110" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859188 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859191 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859194 2555 flags.go:64] FLAG: --memory-manager-policy="None" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859197 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859200 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859203 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859206 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859213 2555 flags.go:64] FLAG: --node-status-max-images="50" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859216 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859220 2555 flags.go:64] FLAG: --oom-score-adj="-999" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859223 2555 flags.go:64] FLAG: --pod-cidr="" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859226 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859231 2555 flags.go:64] FLAG: --pod-manifest-path="" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859234 2555 flags.go:64] FLAG: --pod-max-pids="-1" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859237 2555 flags.go:64] FLAG: --pods-per-core="0" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859239 2555 flags.go:64] FLAG: --port="10250" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859242 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859245 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-099795ce232ede28d" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859249 2555 flags.go:64] FLAG: --qos-reserved="" Sep 13 19:03:50.866022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859251 2555 flags.go:64] FLAG: --read-only-port="10255" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859254 2555 flags.go:64] FLAG: --register-node="true" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859257 2555 flags.go:64] FLAG: --register-with-taints="" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859261 2555 flags.go:64] FLAG: --registry-burst="10" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859264 2555 flags.go:64] FLAG: --registry-qps="5" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859266 2555 flags.go:64] FLAG: --reserved-cpus="" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859269 2555 flags.go:64] FLAG: --reserved-memory="" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859273 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859276 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859278 2555 flags.go:64] FLAG: --rotate-certificates="false" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859281 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859284 2555 flags.go:64] FLAG: --runonce="false" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859291 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859294 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859299 2555 flags.go:64] FLAG: --seccomp-default="false" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859302 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859305 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859308 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859311 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859314 2555 flags.go:64] FLAG: --storage-driver-password="root" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859317 2555 flags.go:64] FLAG: --storage-driver-secure="false" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859320 2555 flags.go:64] FLAG: --storage-driver-table="stats" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859323 2555 flags.go:64] FLAG: --storage-driver-user="root" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859326 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859329 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 13 19:03:50.866619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859332 2555 flags.go:64] FLAG: --system-cgroups="" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859335 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859340 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859343 2555 flags.go:64] FLAG: --tls-cert-file="" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859346 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859351 2555 flags.go:64] FLAG: --tls-min-version="" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859354 2555 flags.go:64] FLAG: --tls-private-key-file="" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859356 2555 flags.go:64] FLAG: --topology-manager-policy="none" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859359 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859362 2555 flags.go:64] FLAG: --topology-manager-scope="container" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859365 2555 flags.go:64] FLAG: --v="2" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859369 2555 flags.go:64] FLAG: --version="false" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859373 2555 flags.go:64] FLAG: --vmodule="" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859377 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859380 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859492 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859497 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859500 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859503 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859508 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859511 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859516 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:03:50.867240 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859520 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859525 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859527 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859530 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859533 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859536 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859538 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859541 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859544 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859547 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859550 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859552 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859555 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859557 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859560 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859563 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859565 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859568 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859571 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859573 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:03:50.867804 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859576 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859579 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859581 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859584 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859587 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859590 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859592 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859595 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859597 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859601 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859604 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859608 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859610 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859614 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859617 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859619 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859624 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859627 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859630 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:03:50.868320 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859633 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859635 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859638 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859640 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859643 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859646 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859648 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859651 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859653 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859656 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859659 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859661 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859664 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859666 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859669 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859672 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859674 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859693 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859697 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859699 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:03:50.868803 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859702 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859704 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859708 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859711 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859715 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859719 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859722 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859727 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859731 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859735 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859738 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859741 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859744 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859747 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859749 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859752 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859755 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859758 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859760 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859763 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:03:50.869297 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859766 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859768 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859771 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859773 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859776 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859779 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859781 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859784 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859786 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859789 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859791 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859794 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.859796 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.859802 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.867656 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 13 19:03:50.869795 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.867793 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.868841 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.868848 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868907 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868912 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868916 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868919 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868922 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868925 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868928 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868931 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868933 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868936 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868939 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868941 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868944 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868947 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868949 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868952 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868954 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:03:50.870187 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868957 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868960 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868963 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868965 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868968 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868971 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868973 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868976 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868978 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868981 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868984 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868986 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868990 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868993 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868996 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.868999 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869001 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869005 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869008 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:03:50.870746 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869010 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869013 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869016 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869018 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869021 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869023 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869026 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869028 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869031 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869034 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869036 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869039 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869041 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869044 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869046 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869049 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869052 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869056 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869060 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:03:50.871207 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869063 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869066 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869069 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869072 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869075 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869078 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869081 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869085 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869089 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869092 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869095 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869098 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869102 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869105 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869107 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869110 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869113 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869116 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869118 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:03:50.871698 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869121 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869125 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869129 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869132 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869135 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869137 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869140 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869143 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869146 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869148 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869151 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869154 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869156 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869159 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869162 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869164 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869167 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869169 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869172 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869175 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:03:50.872160 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869178 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869181 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869183 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869186 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869188 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.869193 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869324 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869329 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869333 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869336 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869339 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869342 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869345 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869348 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869350 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 13 19:03:50.872649 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869353 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869356 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869359 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869362 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869366 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869369 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869372 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869375 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869378 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869380 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869383 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869385 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869388 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869391 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869393 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869396 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869399 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869402 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869405 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869408 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 19:03:50.873032 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869411 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869413 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869416 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869419 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869422 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869425 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869427 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869430 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869432 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869435 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869438 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869440 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869443 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869446 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869448 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869451 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869453 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869456 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869458 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869461 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 19:03:50.873521 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869464 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869466 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869469 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869472 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869474 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869477 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869480 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869483 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869486 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869488 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869491 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869493 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869496 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869499 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869502 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869504 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869507 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869510 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869513 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869515 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 19:03:50.874097 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869518 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869520 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869523 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869525 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869528 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869531 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869533 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869536 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869538 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869541 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869543 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869546 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869548 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869551 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869554 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869556 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869559 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869562 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869565 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869567 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 19:03:50.874582 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869570 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869573 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869576 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869578 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869582 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869585 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869588 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869592 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869594 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:50.869597 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.869603 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.869711 2555 server.go:962] "Client rotation is on, will bootstrap in background" Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.872766 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.874167 2555 server.go:1019] "Starting client certificate rotation" Sep 13 19:03:50.875077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.874273 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 13 19:03:50.875417 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.874303 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 13 19:03:50.877219 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.877206 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 13 19:03:50.878756 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.878737 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 13 19:03:50.888198 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.888181 2555 log.go:25] "Validated CRI v1 runtime API" Sep 13 19:03:50.891442 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.891421 2555 log.go:25] "Validated CRI v1 image API" Sep 13 19:03:50.893154 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.893138 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 13 19:03:50.900711 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.900667 2555 fs.go:135] Filesystem UUIDs: map[456757b2-adff-4a0f-bdfe-093409c50537:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 aeed228e-814d-4728-be17-160dda69d32a:/dev/nvme0n1p4] Sep 13 19:03:50.900772 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.900710 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 13 19:03:50.901812 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.901791 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 13 19:03:50.906067 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.905957 2555 manager.go:216] Machine: {Timestamp:2026-09-13 19:03:50.904482744 +0000 UTC m=+0.372043925 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099542 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27a5a393fb59a65d2b58921bcd07ef SystemUUID:ec27a5a3-93fb-59a6-5d2b-58921bcd07ef BootID:d3ed4b12-34b1-4911-ad65-38e0d58c63f6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f8:cb:78:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f8:cb:78:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:47:97:74:46:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 13 19:03:50.906067 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.906061 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 13 19:03:50.906184 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.906161 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 13 19:03:50.910026 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.909995 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 13 19:03:50.910159 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.910030 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 13 19:03:50.910881 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.910871 2555 topology_manager.go:138] "Creating topology manager with none policy" Sep 13 19:03:50.910921 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.910882 2555 container_manager_linux.go:309] "Creating device plugin manager" Sep 13 19:03:50.910921 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.910890 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 13 19:03:50.910921 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.910904 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 13 19:03:50.912468 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.912458 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 13 19:03:50.916923 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.916912 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 13 19:03:50.917033 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.917023 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 13 19:03:50.917070 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.917051 2555 kubelet.go:486] "Attempting to sync node with API server" Sep 13 19:03:50.917070 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.917060 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 13 19:03:50.917143 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.917071 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 13 19:03:50.917143 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.917081 2555 kubelet.go:398] "Adding apiserver pod source" Sep 13 19:03:50.917143 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.917089 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 13 19:03:50.917428 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.917410 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 13 19:03:50.917428 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.917429 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 13 19:03:50.919822 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.919805 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnlcq" Sep 13 19:03:50.920479 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.920464 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 13 19:03:50.923525 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.923512 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 13 19:03:50.923584 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.923542 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 13 19:03:50.925805 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925793 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 13 19:03:50.925843 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925810 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 13 19:03:50.925843 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925815 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 13 19:03:50.925843 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925821 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 13 19:03:50.925843 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925829 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 13 19:03:50.925843 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925835 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 13 19:03:50.925982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925848 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 13 19:03:50.925982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925853 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 13 19:03:50.925982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925861 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 13 19:03:50.925982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925878 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 13 19:03:50.925982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925890 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 13 19:03:50.925982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925896 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 13 19:03:50.925982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925928 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 13 19:03:50.925982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.925941 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 13 19:03:50.926651 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.926635 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnlcq" Sep 13 19:03:50.927009 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:50.926967 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 13 19:03:50.927084 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:50.927066 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 13 19:03:50.930025 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.930011 2555 server.go:1268] "Started kubelet" Sep 13 19:03:50.930149 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.930099 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 13 19:03:50.930287 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.930236 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 13 19:03:50.930370 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.930345 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 13 19:03:50.930974 ip-10-0-129-197 systemd[1]: Started Kubernetes Kubelet. Sep 13 19:03:50.931915 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.931672 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 13 19:03:50.935204 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.935092 2555 server.go:310] "Adding debug handlers to kubelet server" Sep 13 19:03:50.936999 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:50.936980 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 13 19:03:50.940506 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.940488 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 13 19:03:50.941125 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.941108 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 13 19:03:50.941308 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:50.941284 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:50.941985 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.941965 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-197.ec2.internal" not found Sep 13 19:03:50.941985 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.941970 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 13 19:03:50.942127 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.941990 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 13 19:03:50.942127 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.941971 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 13 19:03:50.942127 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942083 2555 reconstruct.go:97] "Volume reconstruction finished" Sep 13 19:03:50.942127 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942086 2555 factory.go:55] Registering systemd factory Sep 13 19:03:50.942127 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942120 2555 factory.go:223] Registration of the systemd container factory successfully Sep 13 19:03:50.942344 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942090 2555 reconciler.go:29] "Reconciler: start to sync state" Sep 13 19:03:50.942399 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942383 2555 factory.go:153] Registering CRI-O factory Sep 13 19:03:50.942399 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942396 2555 factory.go:223] Registration of the crio container factory successfully Sep 13 19:03:50.942484 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942433 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 13 19:03:50.942484 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942449 2555 factory.go:103] Registering Raw factory Sep 13 19:03:50.942484 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942461 2555 manager.go:1196] Started watching for new ooms in manager Sep 13 19:03:50.942843 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.942829 2555 manager.go:349] Starting recovery of all containers Sep 13 19:03:50.943823 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.943805 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:03:50.946161 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:50.946139 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-197.ec2.internal\" not found" node="ip-10-0-129-197.ec2.internal" Sep 13 19:03:50.954593 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.954579 2555 manager.go:354] Recovery completed Sep 13 19:03:50.955534 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.955519 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-197.ec2.internal" not found Sep 13 19:03:50.959516 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.959501 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:03:50.961137 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.961123 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:03:50.961195 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.961149 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:03:50.961195 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.961161 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:03:50.961838 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.961823 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:03:50.961838 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.961825 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 13 19:03:50.961978 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.961856 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 13 19:03:50.961978 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.961879 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 13 19:03:50.962478 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.962461 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:03:50.962551 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.962485 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:03:50.962551 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.962499 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:03:50.964090 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.964079 2555 policy_none.go:49] "None policy: Start" Sep 13 19:03:50.964131 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.964094 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 13 19:03:50.964131 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.964104 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 13 19:03:50.966160 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.966148 2555 policy_none.go:47] "Start" Sep 13 19:03:50.992239 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.992225 2555 manager.go:337] "Starting Device Plugin manager" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:50.992261 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.992270 2555 server.go:87] "Starting device plugin registration server" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.992485 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.992499 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.992661 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.992756 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:50.992766 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:50.993095 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:50.993134 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.000510 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.002919 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.003256 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.003294 2555 kubelet.go:2448] "Starting kubelet main sync loop" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.003342 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.005216 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:03:51.015488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.012125 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-197.ec2.internal" not found Sep 13 19:03:51.093447 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.093416 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:03:51.094244 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.094230 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:03:51.094333 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.094260 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:03:51.094333 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.094276 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:03:51.094333 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.094302 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.102632 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.102567 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.102632 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.102589 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-197.ec2.internal\": node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.103609 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.103592 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal"] Sep 13 19:03:51.103664 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.103654 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:03:51.104410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.104395 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:03:51.104493 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.104425 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:03:51.104493 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.104440 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:03:51.106759 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.106740 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:03:51.106888 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.106875 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.106960 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.106917 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:03:51.107405 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.107386 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:03:51.107487 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.107413 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:03:51.107487 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.107428 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:03:51.107487 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.107432 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:03:51.107487 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.107459 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:03:51.107487 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.107472 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:03:51.109645 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.109629 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.109737 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.109654 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 19:03:51.110278 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.110263 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientMemory" Sep 13 19:03:51.110325 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.110288 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 19:03:51.110325 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.110297 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeHasSufficientPID" Sep 13 19:03:51.115296 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.115282 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.143229 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.143210 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7be41bc86d149cd2a937e28f8c11cbe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal\" (UID: \"d7be41bc86d149cd2a937e28f8c11cbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.143325 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.143242 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7be41bc86d149cd2a937e28f8c11cbe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal\" (UID: \"d7be41bc86d149cd2a937e28f8c11cbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.143325 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.143276 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-197.ec2.internal\" not found" node="ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.143325 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.143288 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2197d7e4b59d20da0b3277f8979b1b3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-197.ec2.internal\" (UID: \"c2197d7e4b59d20da0b3277f8979b1b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.147620 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.147605 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-197.ec2.internal\" not found" node="ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.216322 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.216300 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.243404 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.243382 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7be41bc86d149cd2a937e28f8c11cbe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal\" (UID: \"d7be41bc86d149cd2a937e28f8c11cbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.243493 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.243406 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7be41bc86d149cd2a937e28f8c11cbe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal\" (UID: \"d7be41bc86d149cd2a937e28f8c11cbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.243493 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.243422 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2197d7e4b59d20da0b3277f8979b1b3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-197.ec2.internal\" (UID: \"c2197d7e4b59d20da0b3277f8979b1b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.243493 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.243446 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2197d7e4b59d20da0b3277f8979b1b3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-197.ec2.internal\" (UID: \"c2197d7e4b59d20da0b3277f8979b1b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.243493 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.243480 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7be41bc86d149cd2a937e28f8c11cbe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal\" (UID: \"d7be41bc86d149cd2a937e28f8c11cbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.243634 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.243509 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d7be41bc86d149cd2a937e28f8c11cbe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal\" (UID: \"d7be41bc86d149cd2a937e28f8c11cbe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.316960 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.316941 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.417547 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.417490 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.447076 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.447047 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.451201 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.451184 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" Sep 13 19:03:51.518470 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.518447 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.618948 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.618926 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.719651 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.719624 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.820797 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.820773 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.873454 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.873418 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 13 19:03:51.873875 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.873585 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 13 19:03:51.873875 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.873599 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 13 19:03:51.921801 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:51.921775 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:51.934464 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.934412 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-12 18:58:51 +0000 UTC" deadline="2028-06-17 17:49:02.643131338 +0000 UTC" Sep 13 19:03:51.934464 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.934459 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15430h45m10.708674823s" Sep 13 19:03:51.976311 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:51.976241 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:03:52.022498 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:52.022275 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-197.ec2.internal\" not found" Sep 13 19:03:52.049539 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.049517 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:03:52.086516 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.086496 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 19:03:52.091636 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:52.091607 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7be41bc86d149cd2a937e28f8c11cbe.slice/crio-46df134f214c2dfe17d1c4ff656d8da6bf6640714dab6dec991f4c1b40aa6814 WatchSource:0}: Error finding container 46df134f214c2dfe17d1c4ff656d8da6bf6640714dab6dec991f4c1b40aa6814: Status 404 returned error can't find the container with id 46df134f214c2dfe17d1c4ff656d8da6bf6640714dab6dec991f4c1b40aa6814 Sep 13 19:03:52.142334 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.142304 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" Sep 13 19:03:52.153037 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.153018 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 13 19:03:52.154275 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.154262 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" Sep 13 19:03:52.164151 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.164135 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 13 19:03:52.918125 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.918094 2555 apiserver.go:52] "Watching apiserver" Sep 13 19:03:52.928977 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.928943 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 13 19:03:52.929368 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.929341 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-488kp","kube-system/global-pull-secret-syncer-gptfs","kube-system/konnectivity-agent-87sx4","openshift-cluster-node-tuning-operator/tuned-xp8n9","openshift-image-registry/node-ca-rj9p8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal","openshift-network-diagnostics/network-check-target-zj48k","kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg","openshift-dns/node-resolver-t4xtb","openshift-multus/multus-5s59c","openshift-multus/multus-additional-cni-plugins-fbbq4","openshift-multus/network-metrics-daemon-q7q4c","openshift-network-operator/iptables-alerter-s9n79"] Sep 13 19:03:52.931931 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.931900 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:52.932053 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:52.932008 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:03:52.934235 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.934213 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:52.934354 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:52.934285 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:03:52.936601 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.936578 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:03:52.938975 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.938879 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 13 19:03:52.939753 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.939407 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nwprg\"" Sep 13 19:03:52.939855 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.939809 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 13 19:03:52.940138 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.939920 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.940735 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.940709 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 13 19:03:52.942683 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.942659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:52.942804 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.942703 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f2pkm\"" Sep 13 19:03:52.943650 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.943626 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 13 19:03:52.944044 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.944026 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 13 19:03:52.945366 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.945346 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 13 19:03:52.946495 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.945584 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z8z5h\"" Sep 13 19:03:52.946495 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.945608 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:52.946495 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.945815 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 13 19:03:52.946495 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.946021 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 13 19:03:52.949331 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.948646 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 13 19:03:52.949331 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.949051 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:52.949625 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.949603 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xfcgk\"" Sep 13 19:03:52.949748 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.949738 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 13 19:03:52.949857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.949841 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 13 19:03:52.951385 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.951365 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:52.951485 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.951386 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 13 19:03:52.952181 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.952090 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 13 19:03:52.952181 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.952177 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ntxlk\"" Sep 13 19:03:52.952435 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.952414 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 13 19:03:52.952924 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.952906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd789\" (UniqueName: \"kubernetes.io/projected/41a24202-69ab-4e25-a5f6-94c597cf883d-kube-api-access-sd789\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953067 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gq4m\" (UniqueName: \"kubernetes.io/projected/a8e1575a-c34e-41c5-a3c7-735fdbda759f-kube-api-access-5gq4m\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:52.953199 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953173 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysctl-d\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953207 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-host\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:52.953306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953262 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2e1573c-2405-45d0-938c-51b85cf35b8c-agent-certs\") pod \"konnectivity-agent-87sx4\" (UID: \"f2e1573c-2405-45d0-938c-51b85cf35b8c\") " pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:03:52.953306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-kubernetes\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953324 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-sys\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41a24202-69ab-4e25-a5f6-94c597cf883d-tmp\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953380 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8e1575a-c34e-41c5-a3c7-735fdbda759f-serviceca\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:52.953531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953412 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:52.953531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2e1573c-2405-45d0-938c-51b85cf35b8c-konnectivity-ca\") pod \"konnectivity-agent-87sx4\" (UID: \"f2e1573c-2405-45d0-938c-51b85cf35b8c\") " pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:03:52.953531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-modprobe-d\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysconfig\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953526 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-lib-modules\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953557 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-tuned\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953579 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8e1575a-c34e-41c5-a3c7-735fdbda759f-host\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:52.953889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953590 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 13 19:03:52.953889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953604 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxwh8\" (UniqueName: \"kubernetes.io/projected/597e5ef6-551e-4d79-abf3-59e08bb4565e-kube-api-access-rxwh8\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:52.953889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953681 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysctl-conf\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-systemd\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-run\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.953889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.953772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-var-lib-kubelet\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:52.954289 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.954049 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:52.954289 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:52.954128 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:03:52.954289 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.954246 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 13 19:03:52.955350 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.955332 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 13 19:03:52.955453 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.955414 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 13 19:03:52.955585 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.955569 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zbcbs\"" Sep 13 19:03:52.955779 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.955338 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 13 19:03:52.955852 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.955788 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 13 19:03:52.956116 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.956092 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 13 19:03:52.957534 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.957513 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:52.959855 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.959835 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5s59c" Sep 13 19:03:52.959974 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.959953 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 13 19:03:52.960582 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.960560 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-99jpz\"" Sep 13 19:03:52.960673 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.960633 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 13 19:03:52.962113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.962093 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:52.963346 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.962959 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 13 19:03:52.963346 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.962989 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fxlq4\"" Sep 13 19:03:52.963346 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.962999 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 13 19:03:52.963346 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.963155 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 13 19:03:52.963346 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.963228 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 13 19:03:52.964976 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.964953 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 13 19:03:52.965748 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.965727 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 13 19:03:52.965748 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.965762 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nj8kn\"" Sep 13 19:03:52.972851 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.972829 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmxdv" Sep 13 19:03:52.980139 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:52.980115 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmxdv" Sep 13 19:03:53.014303 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.014248 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" event={"ID":"d7be41bc86d149cd2a937e28f8c11cbe","Type":"ContainerStarted","Data":"46df134f214c2dfe17d1c4ff656d8da6bf6640714dab6dec991f4c1b40aa6814"} Sep 13 19:03:53.015723 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.015684 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" event={"ID":"c2197d7e4b59d20da0b3277f8979b1b3","Type":"ContainerStarted","Data":"d5040cbcc4eb4a7e96608d61d530c35f549c5cdc4637be5d5512d94e8710949b"} Sep 13 19:03:53.043457 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.043434 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 13 19:03:53.053965 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.053934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-sys-fs\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.054077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054017 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-kubelet\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.054077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-kubelet\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.054156 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054077 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2e1573c-2405-45d0-938c-51b85cf35b8c-konnectivity-ca\") pod \"konnectivity-agent-87sx4\" (UID: \"f2e1573c-2405-45d0-938c-51b85cf35b8c\") " pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:03:53.054156 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-modprobe-d\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.054156 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054146 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysconfig\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.054258 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-systemd-units\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.054258 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054209 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovnkube-config\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.054258 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-cni-multus\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.054355 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054256 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xzpq\" (UniqueName: \"kubernetes.io/projected/f913dc6d-2f2a-41b9-a015-20f2a1962dae-kube-api-access-2xzpq\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.054355 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054287 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-modprobe-d\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.054355 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054307 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd789\" (UniqueName: \"kubernetes.io/projected/41a24202-69ab-4e25-a5f6-94c597cf883d-kube-api-access-sd789\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.054355 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054320 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysconfig\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.054355 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054337 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.054507 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-hosts-file\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.054507 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054480 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-etc-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.054573 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-env-overrides\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.054573 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-cnibin\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.054638 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054569 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-daemon-config\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.054638 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-system-cni-dir\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.054708 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054649 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2e1573c-2405-45d0-938c-51b85cf35b8c-agent-certs\") pod \"konnectivity-agent-87sx4\" (UID: \"f2e1573c-2405-45d0-938c-51b85cf35b8c\") " pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:03:53.054708 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.054814 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054726 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp998\" (UniqueName: \"kubernetes.io/projected/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-kube-api-access-tp998\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.054814 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:53.054922 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054820 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2e1573c-2405-45d0-938c-51b85cf35b8c-konnectivity-ca\") pod \"konnectivity-agent-87sx4\" (UID: \"f2e1573c-2405-45d0-938c-51b85cf35b8c\") " pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:03:53.054996 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.054970 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shk97\" (UniqueName: \"kubernetes.io/projected/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-kube-api-access-shk97\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.055058 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c202984-6312-421c-8916-7cf331df8e91-kubelet-config\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.055113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v42pt\" (UniqueName: \"kubernetes.io/projected/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-kube-api-access-v42pt\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.055113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055098 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxwh8\" (UniqueName: \"kubernetes.io/projected/597e5ef6-551e-4d79-abf3-59e08bb4565e-kube-api-access-rxwh8\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:53.055218 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055129 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-log-socket\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.055218 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055155 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-system-cni-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.055218 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055174 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 13 19:03:53.055218 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055209 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.055492 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.055251 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:03:53.055492 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.055317 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:03:53.555295597 +0000 UTC m=+3.022856780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:03:53.055492 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055477 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c202984-6312-421c-8916-7cf331df8e91-dbus\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.055659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-slash\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.055659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055540 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-conf-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.055659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055573 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-etc-kubernetes\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.055659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055615 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:53.055893 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055799 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41a24202-69ab-4e25-a5f6-94c597cf883d-tmp\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.055893 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-host-slash\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.055893 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-ovn\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.056057 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-lib-modules\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056057 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.055983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-tuned\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056057 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056035 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-lib-modules\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056206 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056077 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gq4m\" (UniqueName: \"kubernetes.io/projected/a8e1575a-c34e-41c5-a3c7-735fdbda759f-kube-api-access-5gq4m\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:53.056263 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056177 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f913dc6d-2f2a-41b9-a015-20f2a1962dae-cni-binary-copy\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.056263 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056233 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysctl-conf\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056263 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-run\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056419 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056285 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-var-lib-kubelet\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056419 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056353 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-var-lib-kubelet\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056419 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056386 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.056419 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056401 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-run\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056419 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056412 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovnkube-script-lib\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056424 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysctl-conf\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056440 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-host\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056489 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-host\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056518 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-tmp-dir\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056617 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-sys\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056642 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-registration-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.056685 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-device-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056719 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-etc-selinux\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056736 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-sys\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-var-lib-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056776 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-cni-bin\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovn-node-metrics-cert\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-cni-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8e1575a-c34e-41c5-a3c7-735fdbda759f-host\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-systemd\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-node-log\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-cni-netd\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056944 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8e1575a-c34e-41c5-a3c7-735fdbda759f-host\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-socket-dir-parent\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.056985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-netns\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-hostroot\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-systemd\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.057215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057090 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-socket-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-cni-bin\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cnibin\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057155 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-systemd\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057174 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysctl-d\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057202 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-iptables-alerter-script\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057226 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c2k9\" (UniqueName: \"kubernetes.io/projected/53feeb41-eb46-46c9-b9c3-79df33cee788-kube-api-access-6c2k9\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057251 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-run-netns\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2lv8\" (UniqueName: \"kubernetes.io/projected/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-kube-api-access-c2lv8\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057281 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-sysctl-d\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-k8s-cni-cncf-io\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-multus-certs\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057416 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-kubernetes\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057442 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8e1575a-c34e-41c5-a3c7-735fdbda759f-serviceca\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057539 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-kubernetes\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.058105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.057945 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8e1575a-c34e-41c5-a3c7-735fdbda759f-serviceca\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:53.059625 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.059595 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41a24202-69ab-4e25-a5f6-94c597cf883d-etc-tuned\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.060197 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.060169 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2e1573c-2405-45d0-938c-51b85cf35b8c-agent-certs\") pod \"konnectivity-agent-87sx4\" (UID: \"f2e1573c-2405-45d0-938c-51b85cf35b8c\") " pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:03:53.060338 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.060316 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41a24202-69ab-4e25-a5f6-94c597cf883d-tmp\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.063537 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.063517 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:03:53.063714 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.063545 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:03:53.063714 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.063561 2555 projected.go:196] Error preparing data for projected volume kube-api-access-2d2fs for pod openshift-network-diagnostics/network-check-target-zj48k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:03:53.063714 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.063619 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs podName:2b7f9cc2-4c61-418e-950f-6b12d94e85d0 nodeName:}" failed. No retries permitted until 2026-09-13 19:03:53.563600761 +0000 UTC m=+3.031161954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2d2fs" (UniqueName: "kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs") pod "network-check-target-zj48k" (UID: "2b7f9cc2-4c61-418e-950f-6b12d94e85d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:03:53.065126 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.065018 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxwh8\" (UniqueName: \"kubernetes.io/projected/597e5ef6-551e-4d79-abf3-59e08bb4565e-kube-api-access-rxwh8\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:53.067430 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.067385 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd789\" (UniqueName: \"kubernetes.io/projected/41a24202-69ab-4e25-a5f6-94c597cf883d-kube-api-access-sd789\") pod \"tuned-xp8n9\" (UID: \"41a24202-69ab-4e25-a5f6-94c597cf883d\") " pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.067942 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.067877 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gq4m\" (UniqueName: \"kubernetes.io/projected/a8e1575a-c34e-41c5-a3c7-735fdbda759f-kube-api-access-5gq4m\") pod \"node-ca-rj9p8\" (UID: \"a8e1575a-c34e-41c5-a3c7-735fdbda759f\") " pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:53.157784 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.157751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f913dc6d-2f2a-41b9-a015-20f2a1962dae-cni-binary-copy\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.157965 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.157805 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.157965 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.157839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovnkube-script-lib\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.157965 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.157858 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.157965 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.157877 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.157965 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.157931 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-tmp-dir\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.158166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.157965 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.158166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.157976 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.158166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158002 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-registration-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.158166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158022 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158055 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158101 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-registration-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.158166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158165 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-device-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158194 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-etc-selinux\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-var-lib-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158246 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-cni-bin\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158273 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovn-node-metrics-cert\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-cni-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158319 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-systemd\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158335 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-node-log\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158377 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-cni-netd\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158376 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-tmp-dir\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158394 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-socket-dir-parent\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158410 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-netns\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158407 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f913dc6d-2f2a-41b9-a015-20f2a1962dae-cni-binary-copy\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158426 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-hostroot\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158454 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-hostroot\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158465 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158499 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-socket-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158527 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-cni-bin\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158547 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-cni-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158554 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cnibin\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158579 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-socket-dir-parent\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158568 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-cni-netd\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158604 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-netns\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158528 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovnkube-script-lib\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158626 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158666 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cnibin\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158678 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-socket-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158582 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-iptables-alerter-script\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.158857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158720 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-device-dir\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158718 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-cni-bin\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158754 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-systemd\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158781 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-etc-selinux\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158781 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c2k9\" (UniqueName: \"kubernetes.io/projected/53feeb41-eb46-46c9-b9c3-79df33cee788-kube-api-access-6c2k9\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158789 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-var-lib-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158810 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-node-log\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158834 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-run-netns\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2lv8\" (UniqueName: \"kubernetes.io/projected/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-kube-api-access-c2lv8\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158892 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-k8s-cni-cncf-io\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158919 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-multus-certs\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158927 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-run-netns\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158977 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-sys-fs\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159007 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-kubelet\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159035 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-kubelet\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-systemd-units\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.159745 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159078 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53feeb41-eb46-46c9-b9c3-79df33cee788-sys-fs\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159087 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovnkube-config\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159123 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-iptables-alerter-script\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159131 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-kubelet\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159166 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-cni-multus\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159194 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-kubelet\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159211 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-k8s-cni-cncf-io\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.158981 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-cni-bin\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159127 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-var-lib-cni-multus\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159249 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-systemd-units\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159256 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-host-run-multus-certs\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159275 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159286 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzpq\" (UniqueName: \"kubernetes.io/projected/f913dc6d-2f2a-41b9-a015-20f2a1962dae-kube-api-access-2xzpq\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159290 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-hosts-file\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159399 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159404 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-hosts-file\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.160552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-etc-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159438 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-env-overrides\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159465 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-cnibin\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159483 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-etc-openvswitch\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159489 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-daemon-config\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159519 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-system-cni-dir\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159537 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp998\" (UniqueName: \"kubernetes.io/projected/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-kube-api-access-tp998\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159561 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-cnibin\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159598 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-system-cni-dir\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159608 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovnkube-config\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159648 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shk97\" (UniqueName: \"kubernetes.io/projected/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-kube-api-access-shk97\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.159663 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159666 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c202984-6312-421c-8916-7cf331df8e91-kubelet-config\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.159714 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c202984-6312-421c-8916-7cf331df8e91-kubelet-config\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160198 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-env-overrides\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.160292 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret podName:6c202984-6312-421c-8916-7cf331df8e91 nodeName:}" failed. No retries permitted until 2026-09-13 19:03:53.660260055 +0000 UTC m=+3.127821242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret") pod "global-pull-secret-syncer-gptfs" (UID: "6c202984-6312-421c-8916-7cf331df8e91") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:03:53.161483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160300 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-daemon-config\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v42pt\" (UniqueName: \"kubernetes.io/projected/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-kube-api-access-v42pt\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160365 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-log-socket\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160399 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-system-cni-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160495 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-system-cni-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160544 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-log-socket\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160670 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160734 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c202984-6312-421c-8916-7cf331df8e91-dbus\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160821 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c202984-6312-421c-8916-7cf331df8e91-dbus\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160868 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-slash\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-conf-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160947 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-etc-kubernetes\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.160994 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-host-slash\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.161000 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-host-slash\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.161038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-ovn\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.161063 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-multus-conf-dir\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.161144 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f913dc6d-2f2a-41b9-a015-20f2a1962dae-etc-kubernetes\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.161155 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-host-slash\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.162300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.161192 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-run-ovn\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.163179 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.161262 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.164211 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.164165 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-ovn-node-metrics-cert\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.168430 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.168368 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2lv8\" (UniqueName: \"kubernetes.io/projected/fcd6e10f-957d-45cd-8990-b0c2ebfc73c6-kube-api-access-c2lv8\") pod \"ovnkube-node-488kp\" (UID: \"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.169315 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.169287 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp998\" (UniqueName: \"kubernetes.io/projected/27e4d6d9-86bc-43ac-b5fa-158b3fef5498-kube-api-access-tp998\") pod \"multus-additional-cni-plugins-fbbq4\" (UID: \"27e4d6d9-86bc-43ac-b5fa-158b3fef5498\") " pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.169994 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.169969 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shk97\" (UniqueName: \"kubernetes.io/projected/f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b-kube-api-access-shk97\") pod \"iptables-alerter-s9n79\" (UID: \"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b\") " pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.170139 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.170029 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xzpq\" (UniqueName: \"kubernetes.io/projected/f913dc6d-2f2a-41b9-a015-20f2a1962dae-kube-api-access-2xzpq\") pod \"multus-5s59c\" (UID: \"f913dc6d-2f2a-41b9-a015-20f2a1962dae\") " pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.170139 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.170042 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c2k9\" (UniqueName: \"kubernetes.io/projected/53feeb41-eb46-46c9-b9c3-79df33cee788-kube-api-access-6c2k9\") pod \"aws-ebs-csi-driver-node-s46qg\" (UID: \"53feeb41-eb46-46c9-b9c3-79df33cee788\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.170552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.170533 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v42pt\" (UniqueName: \"kubernetes.io/projected/a926d14e-1f9e-44e9-99b8-4f78d24c5b43-kube-api-access-v42pt\") pod \"node-resolver-t4xtb\" (UID: \"a926d14e-1f9e-44e9-99b8-4f78d24c5b43\") " pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.238596 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.238572 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:03:53.254136 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.254111 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:03:53.264970 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.264951 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" Sep 13 19:03:53.274740 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.274717 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rj9p8" Sep 13 19:03:53.281553 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.281535 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s9n79" Sep 13 19:03:53.290589 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.290555 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" Sep 13 19:03:53.298592 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.298570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:03:53.306584 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.306565 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t4xtb" Sep 13 19:03:53.315306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.315283 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5s59c" Sep 13 19:03:53.322141 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.322124 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" Sep 13 19:03:53.450228 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.450155 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 19:03:53.565041 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.565013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:53.565194 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.565051 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:53.565194 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.565172 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:03:53.565194 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.565178 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:03:53.565194 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.565190 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:03:53.565362 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.565202 2555 projected.go:196] Error preparing data for projected volume kube-api-access-2d2fs for pod openshift-network-diagnostics/network-check-target-zj48k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:03:53.565362 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.565249 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:03:54.565230677 +0000 UTC m=+4.032791856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:03:53.565362 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.565271 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs podName:2b7f9cc2-4c61-418e-950f-6b12d94e85d0 nodeName:}" failed. No retries permitted until 2026-09-13 19:03:54.565259788 +0000 UTC m=+4.032820963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d2fs" (UniqueName: "kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs") pod "network-check-target-zj48k" (UID: "2b7f9cc2-4c61-418e-950f-6b12d94e85d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:03:53.666031 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.665993 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:53.666213 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.666149 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:03:53.666213 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:53.666210 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret podName:6c202984-6312-421c-8916-7cf331df8e91 nodeName:}" failed. No retries permitted until 2026-09-13 19:03:54.666192203 +0000 UTC m=+4.133753387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret") pod "global-pull-secret-syncer-gptfs" (UID: "6c202984-6312-421c-8916-7cf331df8e91") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:03:53.983413 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.983347 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-12 18:58:53 +0000 UTC" deadline="2028-03-08 02:04:46.851688023 +0000 UTC" Sep 13 19:03:53.983413 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:53.983410 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12991h0m52.868281741s" Sep 13 19:03:54.003928 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:54.003905 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:54.004081 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.004015 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:03:54.133590 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:54.133562 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd6e10f_957d_45cd_8990_b0c2ebfc73c6.slice/crio-e5cc1149c5c8006652c471b977232d048cf011e530b5f0cb68702acf2dec4ebd WatchSource:0}: Error finding container e5cc1149c5c8006652c471b977232d048cf011e530b5f0cb68702acf2dec4ebd: Status 404 returned error can't find the container with id e5cc1149c5c8006652c471b977232d048cf011e530b5f0cb68702acf2dec4ebd Sep 13 19:03:54.136615 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:54.136589 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf913dc6d_2f2a_41b9_a015_20f2a1962dae.slice/crio-6681b7272e92a96523f4355ccddc86b80988eaf6e7ad432c3cbcf927419d973b WatchSource:0}: Error finding container 6681b7272e92a96523f4355ccddc86b80988eaf6e7ad432c3cbcf927419d973b: Status 404 returned error can't find the container with id 6681b7272e92a96523f4355ccddc86b80988eaf6e7ad432c3cbcf927419d973b Sep 13 19:03:54.138611 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:54.138584 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fc7c15_e538_42d6_b4e8_ca9e13fcbf2b.slice/crio-a7f2e0aaaa89c596c5e73250b8987457fc424dbca1223ccb470e3180146b3c30 WatchSource:0}: Error finding container a7f2e0aaaa89c596c5e73250b8987457fc424dbca1223ccb470e3180146b3c30: Status 404 returned error can't find the container with id a7f2e0aaaa89c596c5e73250b8987457fc424dbca1223ccb470e3180146b3c30 Sep 13 19:03:54.140140 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:54.140119 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53feeb41_eb46_46c9_b9c3_79df33cee788.slice/crio-0e8463428d283e76235970728c11f882f884b2478ac651c35b415cef8ef14984 WatchSource:0}: Error finding container 0e8463428d283e76235970728c11f882f884b2478ac651c35b415cef8ef14984: Status 404 returned error can't find the container with id 0e8463428d283e76235970728c11f882f884b2478ac651c35b415cef8ef14984 Sep 13 19:03:54.142421 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:03:54.142394 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e1575a_c34e_41c5_a3c7_735fdbda759f.slice/crio-7005c877d482ef391e5c423dc69099359673bc3a9247d0194d1fd8533bc58ed8 WatchSource:0}: Error finding container 7005c877d482ef391e5c423dc69099359673bc3a9247d0194d1fd8533bc58ed8: Status 404 returned error can't find the container with id 7005c877d482ef391e5c423dc69099359673bc3a9247d0194d1fd8533bc58ed8 Sep 13 19:03:54.573466 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:54.572551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:54.573466 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:54.572604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:54.573466 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.572775 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:03:54.573466 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.572795 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:03:54.573466 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.572810 2555 projected.go:196] Error preparing data for projected volume kube-api-access-2d2fs for pod openshift-network-diagnostics/network-check-target-zj48k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:03:54.573466 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.572874 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs podName:2b7f9cc2-4c61-418e-950f-6b12d94e85d0 nodeName:}" failed. No retries permitted until 2026-09-13 19:03:56.572851702 +0000 UTC m=+6.040412885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d2fs" (UniqueName: "kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs") pod "network-check-target-zj48k" (UID: "2b7f9cc2-4c61-418e-950f-6b12d94e85d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:03:54.573466 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.573374 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:03:54.573466 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.573429 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:03:56.573413035 +0000 UTC m=+6.040974220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:03:54.674034 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:54.673334 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:54.674034 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.673547 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:03:54.674034 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:54.673611 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret podName:6c202984-6312-421c-8916-7cf331df8e91 nodeName:}" failed. No retries permitted until 2026-09-13 19:03:56.67359236 +0000 UTC m=+6.141153545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret") pod "global-pull-secret-syncer-gptfs" (UID: "6c202984-6312-421c-8916-7cf331df8e91") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:03:54.983858 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:54.983760 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-12 18:58:53 +0000 UTC" deadline="2028-06-20 20:31:45.69062579 +0000 UTC" Sep 13 19:03:54.983858 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:54.983807 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15505h27m50.706824481s" Sep 13 19:03:55.006935 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.006203 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:55.006935 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:55.006330 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:03:55.006935 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.006739 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:55.006935 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:55.006855 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:03:55.050303 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.050266 2555 generic.go:356] "Generic (PLEG): container finished" podID="d7be41bc86d149cd2a937e28f8c11cbe" containerID="3b69573e1f87a8356143d7e6d13660507b831b1e3ece0ae52708281d9f4d2815" exitCode=0 Sep 13 19:03:55.050465 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.050356 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" event={"ID":"d7be41bc86d149cd2a937e28f8c11cbe","Type":"ContainerDied","Data":"3b69573e1f87a8356143d7e6d13660507b831b1e3ece0ae52708281d9f4d2815"} Sep 13 19:03:55.074475 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.074443 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" event={"ID":"c2197d7e4b59d20da0b3277f8979b1b3","Type":"ContainerStarted","Data":"b03229b3fb2d4757ebe7d5dddad457a2100a96b0b7e6c2b933d60013882f2d02"} Sep 13 19:03:55.090587 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.090511 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-197.ec2.internal" podStartSLOduration=3.090490322 podStartE2EDuration="3.090490322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:03:55.089407696 +0000 UTC m=+4.556968891" watchObservedRunningTime="2026-09-13 19:03:55.090490322 +0000 UTC m=+4.558051519" Sep 13 19:03:55.093633 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.093576 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rj9p8" event={"ID":"a8e1575a-c34e-41c5-a3c7-735fdbda759f","Type":"ContainerStarted","Data":"7005c877d482ef391e5c423dc69099359673bc3a9247d0194d1fd8533bc58ed8"} Sep 13 19:03:55.106800 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.103547 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" event={"ID":"53feeb41-eb46-46c9-b9c3-79df33cee788","Type":"ContainerStarted","Data":"0e8463428d283e76235970728c11f882f884b2478ac651c35b415cef8ef14984"} Sep 13 19:03:55.121509 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.121272 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s9n79" event={"ID":"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b","Type":"ContainerStarted","Data":"a7f2e0aaaa89c596c5e73250b8987457fc424dbca1223ccb470e3180146b3c30"} Sep 13 19:03:55.147294 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.147228 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" event={"ID":"27e4d6d9-86bc-43ac-b5fa-158b3fef5498","Type":"ContainerStarted","Data":"074aa2b96bb962b0b2fca3067022fb38b0a937199a1f77e8eadffe7e91c61f5c"} Sep 13 19:03:55.157440 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.157408 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-87sx4" event={"ID":"f2e1573c-2405-45d0-938c-51b85cf35b8c","Type":"ContainerStarted","Data":"a2da66d368f12168fd8193353c9e4a77189ea2aa83f602b0e42ecdd40c163c83"} Sep 13 19:03:55.169453 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.169356 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t4xtb" event={"ID":"a926d14e-1f9e-44e9-99b8-4f78d24c5b43","Type":"ContainerStarted","Data":"16c946fdccd11110ec36abe1301ffba2e17338a7f82b698210b679325cfb79a9"} Sep 13 19:03:55.183204 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.183170 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" event={"ID":"41a24202-69ab-4e25-a5f6-94c597cf883d","Type":"ContainerStarted","Data":"7382b2e8e37350b1b9ac1c7121eaf0c3ef1116834c0d6321230322e4906bc4e0"} Sep 13 19:03:55.187052 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.187021 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5s59c" event={"ID":"f913dc6d-2f2a-41b9-a015-20f2a1962dae","Type":"ContainerStarted","Data":"6681b7272e92a96523f4355ccddc86b80988eaf6e7ad432c3cbcf927419d973b"} Sep 13 19:03:55.191969 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:55.191944 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"e5cc1149c5c8006652c471b977232d048cf011e530b5f0cb68702acf2dec4ebd"} Sep 13 19:03:56.004073 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:56.003947 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:56.004552 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.004180 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:03:56.211534 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:56.211441 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" event={"ID":"d7be41bc86d149cd2a937e28f8c11cbe","Type":"ContainerStarted","Data":"ab7f5f38e69a0079be21e8affcf5b35e9ca961f2cdd5235a4f9c8ba578766bf5"} Sep 13 19:03:56.229107 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:56.229051 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-197.ec2.internal" podStartSLOduration=4.229028949 podStartE2EDuration="4.229028949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:03:56.228416166 +0000 UTC m=+5.695977350" watchObservedRunningTime="2026-09-13 19:03:56.229028949 +0000 UTC m=+5.696590142" Sep 13 19:03:56.588985 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:56.588083 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:56.588985 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:56.588139 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:56.588985 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.588297 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:03:56.588985 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.588329 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:03:56.588985 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.588344 2555 projected.go:196] Error preparing data for projected volume kube-api-access-2d2fs for pod openshift-network-diagnostics/network-check-target-zj48k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:03:56.588985 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.588401 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs podName:2b7f9cc2-4c61-418e-950f-6b12d94e85d0 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:00.588381746 +0000 UTC m=+10.055942921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d2fs" (UniqueName: "kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs") pod "network-check-target-zj48k" (UID: "2b7f9cc2-4c61-418e-950f-6b12d94e85d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:03:56.588985 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.588848 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:03:56.588985 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.588906 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:04:00.588889788 +0000 UTC m=+10.056450963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:03:56.689789 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:56.688873 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:56.689789 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.689090 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:03:56.689789 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:56.689159 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret podName:6c202984-6312-421c-8916-7cf331df8e91 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:00.68913842 +0000 UTC m=+10.156699621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret") pod "global-pull-secret-syncer-gptfs" (UID: "6c202984-6312-421c-8916-7cf331df8e91") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:03:57.004441 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:57.003655 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:57.004441 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:57.003818 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:03:57.004441 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:57.004018 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:57.004441 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:57.004335 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:03:58.004630 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:58.004106 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:03:58.004630 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:58.004261 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:03:59.004412 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:59.004376 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:03:59.004618 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:59.004518 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:03:59.004618 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:03:59.004581 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:03:59.005025 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:03:59.004701 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:00.003894 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:00.003818 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:00.004039 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.003939 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:00.624572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:00.624535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:00.625046 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:00.624590 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:00.625046 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.624709 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:04:00.625046 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.624734 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:04:00.625046 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.624753 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:04:00.625046 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.624767 2555 projected.go:196] Error preparing data for projected volume kube-api-access-2d2fs for pod openshift-network-diagnostics/network-check-target-zj48k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:04:00.625046 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.624787 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:04:08.62476611 +0000 UTC m=+18.092327277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:04:00.625046 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.624809 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs podName:2b7f9cc2-4c61-418e-950f-6b12d94e85d0 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:08.62479775 +0000 UTC m=+18.092358930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d2fs" (UniqueName: "kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs") pod "network-check-target-zj48k" (UID: "2b7f9cc2-4c61-418e-950f-6b12d94e85d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:04:00.725129 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:00.725086 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:00.725280 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.725211 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:04:00.725352 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:00.725287 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret podName:6c202984-6312-421c-8916-7cf331df8e91 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:08.72526844 +0000 UTC m=+18.192829610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret") pod "global-pull-secret-syncer-gptfs" (UID: "6c202984-6312-421c-8916-7cf331df8e91") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:04:01.004440 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:01.004364 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:01.004709 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:01.004405 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:01.004834 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:01.004804 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:01.004929 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:01.004906 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:02.004381 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:02.004251 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:02.004863 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:02.004397 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:03.004772 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:03.004272 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:03.004772 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:03.004313 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:03.004772 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:03.004416 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:03.004772 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:03.004533 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:04.004279 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:04.004240 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:04.004474 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:04.004388 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:05.004258 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:05.004098 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:05.004258 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:05.004232 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:05.004731 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:05.004295 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:05.004731 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:05.004428 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:06.004032 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:06.003994 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:06.004185 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:06.004112 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:07.004396 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:07.004367 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:07.004885 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:07.004492 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:07.004885 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:07.004541 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:07.004885 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:07.004644 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:08.003925 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:08.003894 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:08.004103 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.004006 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:08.683737 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:08.683700 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:08.684211 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:08.683756 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:08.684211 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.683873 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:04:08.684211 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.683942 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:04:08.684211 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.683962 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:04:08.684211 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.683974 2555 projected.go:196] Error preparing data for projected volume kube-api-access-2d2fs for pod openshift-network-diagnostics/network-check-target-zj48k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:04:08.684211 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.683949 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:04:24.683927814 +0000 UTC m=+34.151488999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:04:08.684211 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.684031 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs podName:2b7f9cc2-4c61-418e-950f-6b12d94e85d0 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:24.684015809 +0000 UTC m=+34.151576988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d2fs" (UniqueName: "kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs") pod "network-check-target-zj48k" (UID: "2b7f9cc2-4c61-418e-950f-6b12d94e85d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:04:08.784219 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:08.784188 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:08.784391 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.784306 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:04:08.784391 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:08.784359 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret podName:6c202984-6312-421c-8916-7cf331df8e91 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:24.78434754 +0000 UTC m=+34.251908722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret") pod "global-pull-secret-syncer-gptfs" (UID: "6c202984-6312-421c-8916-7cf331df8e91") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:04:09.004546 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:09.004475 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:09.004736 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:09.004476 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:09.004736 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:09.004625 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:09.004736 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:09.004662 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:10.004524 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:10.004481 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:10.007707 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:10.005037 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:11.005483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:11.005091 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:11.005483 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:11.005185 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:11.005483 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:11.005202 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:11.005483 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:11.005294 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:12.003615 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:12.003584 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:12.003787 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:12.003699 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:12.251660 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:12.251049 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-87sx4" event={"ID":"f2e1573c-2405-45d0-938c-51b85cf35b8c","Type":"ContainerStarted","Data":"e85125f09eb82d552b76b6e655f52d2bb9b8375f1a5a7567a0bc2f90956ca0d3"} Sep 13 19:04:12.255045 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:12.253794 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" event={"ID":"41a24202-69ab-4e25-a5f6-94c597cf883d","Type":"ContainerStarted","Data":"9981dd912be0c274c5e1f36bec179d4c648236a5e21b824064d188b80927c04c"} Sep 13 19:04:12.293562 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:12.293509 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-87sx4" podStartSLOduration=10.658572779 podStartE2EDuration="21.293488921s" totalImagesPullingTime="10.634916142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:12.265827802 +0000 UTC m=+21.733388992" watchObservedRunningTime="2026-09-13 19:04:12.293488921 +0000 UTC m=+21.761050113" Sep 13 19:04:12.293976 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:12.293935 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xp8n9" podStartSLOduration=3.328006543 podStartE2EDuration="21.293921464s" totalImagesPullingTime="17.965914921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:12.288776969 +0000 UTC m=+21.756338153" watchObservedRunningTime="2026-09-13 19:04:12.293921464 +0000 UTC m=+21.761482654" Sep 13 19:04:13.004082 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.003863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:13.004318 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.003863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:13.004318 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:13.004218 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:13.004435 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:13.004315 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:13.256856 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.256826 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rj9p8" event={"ID":"a8e1575a-c34e-41c5-a3c7-735fdbda759f","Type":"ContainerStarted","Data":"1de3345333179cb0409cffc55b6045d71e81871526b74c66ed4fcae036fb13c5"} Sep 13 19:04:13.258383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.258360 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" event={"ID":"53feeb41-eb46-46c9-b9c3-79df33cee788","Type":"ContainerStarted","Data":"d89773041eaa4e333a321320e79821f8a29e083c156e9dd486736dab3b49889a"} Sep 13 19:04:13.259837 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.259807 2555 generic.go:356] "Generic (PLEG): container finished" podID="27e4d6d9-86bc-43ac-b5fa-158b3fef5498" containerID="979dcacef84e92d5fc5ca4e34490fbaa7a810f7a216fcfc1507ef9e91223f81e" exitCode=0 Sep 13 19:04:13.259907 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.259877 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" event={"ID":"27e4d6d9-86bc-43ac-b5fa-158b3fef5498","Type":"ContainerDied","Data":"979dcacef84e92d5fc5ca4e34490fbaa7a810f7a216fcfc1507ef9e91223f81e"} Sep 13 19:04:13.261509 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.261489 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t4xtb" event={"ID":"a926d14e-1f9e-44e9-99b8-4f78d24c5b43","Type":"ContainerStarted","Data":"e735bc4b9e654e267d556ace35906fe3511b7b35646eb42e3ba5b07a3feabf86"} Sep 13 19:04:13.262931 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.262911 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5s59c" event={"ID":"f913dc6d-2f2a-41b9-a015-20f2a1962dae","Type":"ContainerStarted","Data":"b274e65ba6f45bca7e21b27c883a9fbfe83b88df12a59623a11b44b87b8ba682"} Sep 13 19:04:13.265848 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.265829 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"cbd36e3dac01ec02da2699c84e8e65befaecb8f37db8cc2a03742fd5b9350eb1"} Sep 13 19:04:13.265926 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.265885 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"b03bb5ac903028804f1188b469beca3644aa4a8cd68fe554b53f1318f9ad6b3f"} Sep 13 19:04:13.265968 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.265929 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"bd9a58f4151a8bff7b5ad9c1417c355359909fd6c9597c2487bb79379b3725cb"} Sep 13 19:04:13.266001 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.265983 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"6e5f617be378a32b2321583beb23d1128388a5234dbc559d5a8e870610421843"} Sep 13 19:04:13.266041 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.266030 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"e5921d36b4e0036cb4902023893d5dee4deccfc39765c24fae024e8b8254df45"} Sep 13 19:04:13.266093 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.266083 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"174f7ecb5132be1b9baddc70fe34ba0d0d91123efea5b30ee3e9dde11503b451"} Sep 13 19:04:13.269856 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.269819 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rj9p8" podStartSLOduration=4.303707626 podStartE2EDuration="22.269808024s" totalImagesPullingTime="17.966100398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:13.269665398 +0000 UTC m=+22.737226586" watchObservedRunningTime="2026-09-13 19:04:13.269808024 +0000 UTC m=+22.737369213" Sep 13 19:04:13.283966 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.283932 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t4xtb" podStartSLOduration=4.321090351 podStartE2EDuration="22.283916855s" totalImagesPullingTime="17.962826504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:13.2832501 +0000 UTC m=+22.750811290" watchObservedRunningTime="2026-09-13 19:04:13.283916855 +0000 UTC m=+22.751478045" Sep 13 19:04:13.315861 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.315830 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5s59c" podStartSLOduration=4.293686305 podStartE2EDuration="22.315818948s" totalImagesPullingTime="18.022132643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:13.315710623 +0000 UTC m=+22.783271810" watchObservedRunningTime="2026-09-13 19:04:13.315818948 +0000 UTC m=+22.783380136" Sep 13 19:04:13.668022 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:13.667996 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 13 19:04:14.004013 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.003875 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-13T19:04:13.668016181Z","UUID":"9234c43f-d8a6-473a-8def-41ca52cf0026","Handler":null,"Name":"","Endpoint":""} Sep 13 19:04:14.004013 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.003997 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:14.004270 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:14.004118 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:14.005298 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.005281 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 13 19:04:14.005403 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.005309 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 13 19:04:14.269555 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.269471 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s9n79" event={"ID":"f9fc7c15-e538-42d6-b4e8-ca9e13fcbf2b","Type":"ContainerStarted","Data":"305df4f6e5e0fbd784a0b334028e289333343f287c2575bfc1dbeb9d3174516b"} Sep 13 19:04:14.271735 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.271704 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" event={"ID":"53feeb41-eb46-46c9-b9c3-79df33cee788","Type":"ContainerStarted","Data":"cc52c1ba537a03ed64cc410ece170df1783bf437286773d360fcb7e6e1e39725"} Sep 13 19:04:14.283102 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.283066 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s9n79" podStartSLOduration=5.312011994 podStartE2EDuration="23.283053223s" totalImagesPullingTime="17.971041229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:14.282717474 +0000 UTC m=+23.750278664" watchObservedRunningTime="2026-09-13 19:04:14.283053223 +0000 UTC m=+23.750614411" Sep 13 19:04:14.526535 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.526469 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:04:14.527186 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:14.527164 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:04:15.004245 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:15.004212 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:15.004424 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:15.004338 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:15.004424 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:15.004389 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:15.004543 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:15.004471 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:15.276263 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:15.276221 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" event={"ID":"53feeb41-eb46-46c9-b9c3-79df33cee788","Type":"ContainerStarted","Data":"0f7c3d18fb8f122bac623a3f20c797d6c90d684701096f3dd80414550dc692c8"} Sep 13 19:04:15.280413 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:15.280386 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"2add1a0b8b8d09ad0232123aeb27c078c15d999f36f939db1d4444a57670901c"} Sep 13 19:04:15.280583 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:15.280466 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:04:15.281047 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:15.281029 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-87sx4" Sep 13 19:04:15.293089 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:15.293043 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s46qg" podStartSLOduration=4.026816158 podStartE2EDuration="24.293030427s" totalImagesPullingTime="20.266214269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:15.292413358 +0000 UTC m=+24.759974555" watchObservedRunningTime="2026-09-13 19:04:15.293030427 +0000 UTC m=+24.760591616" Sep 13 19:04:16.003955 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:16.003924 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:16.004118 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:16.004043 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:17.004151 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:17.004114 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:17.004151 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:17.004149 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:17.004654 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:17.004252 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:17.004654 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:17.004360 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:18.004277 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.004254 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:18.004947 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:18.004352 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:18.289295 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.289210 2555 generic.go:356] "Generic (PLEG): container finished" podID="27e4d6d9-86bc-43ac-b5fa-158b3fef5498" containerID="3432ed59c046fa5ba2035058e02b9bfff81bf8432916af71b110f65bd2a8ad7d" exitCode=0 Sep 13 19:04:18.289468 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.289295 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" event={"ID":"27e4d6d9-86bc-43ac-b5fa-158b3fef5498","Type":"ContainerDied","Data":"3432ed59c046fa5ba2035058e02b9bfff81bf8432916af71b110f65bd2a8ad7d"} Sep 13 19:04:18.293222 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.293202 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" event={"ID":"fcd6e10f-957d-45cd-8990-b0c2ebfc73c6","Type":"ContainerStarted","Data":"69bacc23c108ad2720ac5e1b9ec11c6989e176459feb34e31a163843d9321da5"} Sep 13 19:04:18.293549 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.293525 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:04:18.293636 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.293598 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:04:18.293699 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.293659 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:04:18.309420 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.309397 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:04:18.309574 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.309560 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:04:18.353555 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:18.353514 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" podStartSLOduration=9.344067089 podStartE2EDuration="27.353501301s" totalImagesPullingTime="18.009434212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:18.328671342 +0000 UTC m=+27.796232532" watchObservedRunningTime="2026-09-13 19:04:18.353501301 +0000 UTC m=+27.821062489" Sep 13 19:04:19.004731 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.004526 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:19.005203 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.004558 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:19.005203 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:19.004770 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:19.005203 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:19.004885 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:19.111623 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.111592 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:19.193839 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.193816 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:19.244337 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.244312 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gptfs"] Sep 13 19:04:19.247525 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.247499 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zj48k"] Sep 13 19:04:19.248266 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.248236 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q7q4c"] Sep 13 19:04:19.248382 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.248366 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:19.248518 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:19.248494 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:19.297510 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.297406 2555 generic.go:356] "Generic (PLEG): container finished" podID="27e4d6d9-86bc-43ac-b5fa-158b3fef5498" containerID="f3a7020fd801476774739aaf7f20aeb2b786ebc009a90c40e97a5a056e2907f9" exitCode=0 Sep 13 19:04:19.297627 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.297505 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" event={"ID":"27e4d6d9-86bc-43ac-b5fa-158b3fef5498","Type":"ContainerDied","Data":"f3a7020fd801476774739aaf7f20aeb2b786ebc009a90c40e97a5a056e2907f9"} Sep 13 19:04:19.297627 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.297589 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:19.297918 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:19.297893 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:19.298038 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:19.297945 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:19.298038 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:19.298032 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:21.004551 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:21.004518 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:21.005014 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:21.004618 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:21.005014 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:21.004650 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:21.005014 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:21.004658 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:21.005014 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:21.004778 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:21.005014 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:21.004881 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:21.303931 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:21.303857 2555 generic.go:356] "Generic (PLEG): container finished" podID="27e4d6d9-86bc-43ac-b5fa-158b3fef5498" containerID="883b7f8e2655897d72a8be3a1af9cfb0256baf25fec533d7ed57652c61b6fa80" exitCode=0 Sep 13 19:04:21.303931 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:21.303920 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" event={"ID":"27e4d6d9-86bc-43ac-b5fa-158b3fef5498","Type":"ContainerDied","Data":"883b7f8e2655897d72a8be3a1af9cfb0256baf25fec533d7ed57652c61b6fa80"} Sep 13 19:04:23.007991 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:23.007963 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:23.008453 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:23.008064 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj48k" podUID="2b7f9cc2-4c61-418e-950f-6b12d94e85d0" Sep 13 19:04:23.008453 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:23.008145 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:23.008453 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:23.008285 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:04:23.008453 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:23.008368 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:23.008658 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:23.008465 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gptfs" podUID="6c202984-6312-421c-8916-7cf331df8e91" Sep 13 19:04:23.838434 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:23.838241 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:23.888252 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:23.888221 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:24.699663 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.699613 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:24.700088 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.699674 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:24.700088 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:24.699786 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:04:24.700088 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:24.699846 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 19:04:24.700088 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:24.699859 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:04:56.699841162 +0000 UTC m=+66.167402331 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 19:04:24.700088 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:24.699863 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 19:04:24.700088 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:24.699878 2555 projected.go:196] Error preparing data for projected volume kube-api-access-2d2fs for pod openshift-network-diagnostics/network-check-target-zj48k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:04:24.700088 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:24.699927 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs podName:2b7f9cc2-4c61-418e-950f-6b12d94e85d0 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:56.699911863 +0000 UTC m=+66.167473030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d2fs" (UniqueName: "kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs") pod "network-check-target-zj48k" (UID: "2b7f9cc2-4c61-418e-950f-6b12d94e85d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 19:04:24.800018 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.799986 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:24.800191 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:24.800157 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 19:04:24.800255 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:24.800234 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret podName:6c202984-6312-421c-8916-7cf331df8e91 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:56.800213995 +0000 UTC m=+66.267775183 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret") pod "global-pull-secret-syncer-gptfs" (UID: "6c202984-6312-421c-8916-7cf331df8e91") : object "kube-system"/"original-pull-secret" not registered Sep 13 19:04:24.876409 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.876379 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-197.ec2.internal" event="NodeReady" Sep 13 19:04:24.876575 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.876516 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 13 19:04:24.916893 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.916828 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-96g96"] Sep 13 19:04:24.921676 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.921648 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7cw7l"] Sep 13 19:04:24.921808 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.921786 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-96g96" Sep 13 19:04:24.924234 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.924137 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 13 19:04:24.924234 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.924226 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 13 19:04:24.924234 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.924232 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kkpnt\"" Sep 13 19:04:24.925261 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.925242 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7cw7l" Sep 13 19:04:24.927761 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.927731 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b8nhs\"" Sep 13 19:04:24.927845 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.927773 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 13 19:04:24.927929 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.927913 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 13 19:04:24.928072 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.928056 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 13 19:04:24.929941 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.929921 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-96g96"] Sep 13 19:04:24.932281 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:24.932259 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7cw7l"] Sep 13 19:04:25.001564 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.001538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsc8b\" (UniqueName: \"kubernetes.io/projected/d34d8388-f6d9-4608-996e-c3238f3886e6-kube-api-access-tsc8b\") pod \"ingress-canary-7cw7l\" (UID: \"d34d8388-f6d9-4608-996e-c3238f3886e6\") " pod="openshift-ingress-canary/ingress-canary-7cw7l" Sep 13 19:04:25.001564 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.001565 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.001793 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.001597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d34d8388-f6d9-4608-996e-c3238f3886e6-cert\") pod \"ingress-canary-7cw7l\" (UID: \"d34d8388-f6d9-4608-996e-c3238f3886e6\") " pod="openshift-ingress-canary/ingress-canary-7cw7l" Sep 13 19:04:25.001793 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.001637 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc80f67-6120-4bb9-97f1-4d4802174ba2-tmp-dir\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.001793 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.001739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5q9c\" (UniqueName: \"kubernetes.io/projected/2bc80f67-6120-4bb9-97f1-4d4802174ba2-kube-api-access-s5q9c\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.001793 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.001777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bc80f67-6120-4bb9-97f1-4d4802174ba2-config-volume\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.003654 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.003620 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:25.003654 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.003629 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:25.003855 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.003742 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:25.006468 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.006251 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cs6ck\"" Sep 13 19:04:25.006468 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.006276 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 13 19:04:25.006468 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.006329 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 13 19:04:25.006468 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.006443 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 13 19:04:25.006736 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.006515 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-454nd\"" Sep 13 19:04:25.006736 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.006582 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 13 19:04:25.026470 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.026380 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:25.074040 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.074012 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:25.102768 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.102749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc80f67-6120-4bb9-97f1-4d4802174ba2-tmp-dir\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.102881 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.102817 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5q9c\" (UniqueName: \"kubernetes.io/projected/2bc80f67-6120-4bb9-97f1-4d4802174ba2-kube-api-access-s5q9c\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.102881 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.102858 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bc80f67-6120-4bb9-97f1-4d4802174ba2-config-volume\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.102993 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.102887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsc8b\" (UniqueName: \"kubernetes.io/projected/d34d8388-f6d9-4608-996e-c3238f3886e6-kube-api-access-tsc8b\") pod \"ingress-canary-7cw7l\" (UID: \"d34d8388-f6d9-4608-996e-c3238f3886e6\") " pod="openshift-ingress-canary/ingress-canary-7cw7l" Sep 13 19:04:25.102993 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.102912 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.103102 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.103079 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc80f67-6120-4bb9-97f1-4d4802174ba2-tmp-dir\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.103165 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.103149 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d34d8388-f6d9-4608-996e-c3238f3886e6-cert\") pod \"ingress-canary-7cw7l\" (UID: \"d34d8388-f6d9-4608-996e-c3238f3886e6\") " pod="openshift-ingress-canary/ingress-canary-7cw7l" Sep 13 19:04:25.103326 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:25.103304 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:04:25.103400 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:25.103377 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:25.603363383 +0000 UTC m=+35.070924563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:04:25.103863 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.103838 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bc80f67-6120-4bb9-97f1-4d4802174ba2-config-volume\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.107990 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.107971 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d34d8388-f6d9-4608-996e-c3238f3886e6-cert\") pod \"ingress-canary-7cw7l\" (UID: \"d34d8388-f6d9-4608-996e-c3238f3886e6\") " pod="openshift-ingress-canary/ingress-canary-7cw7l" Sep 13 19:04:25.111582 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.111560 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5q9c\" (UniqueName: \"kubernetes.io/projected/2bc80f67-6120-4bb9-97f1-4d4802174ba2-kube-api-access-s5q9c\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.111976 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.111952 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsc8b\" (UniqueName: \"kubernetes.io/projected/d34d8388-f6d9-4608-996e-c3238f3886e6-kube-api-access-tsc8b\") pod \"ingress-canary-7cw7l\" (UID: \"d34d8388-f6d9-4608-996e-c3238f3886e6\") " pod="openshift-ingress-canary/ingress-canary-7cw7l" Sep 13 19:04:25.241272 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.241183 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7cw7l" Sep 13 19:04:25.610440 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.610405 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:25.610625 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:25.610603 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:04:25.610702 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:25.610691 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:26.610659627 +0000 UTC m=+36.078220795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:04:25.882371 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:25.882305 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7cw7l"] Sep 13 19:04:25.894500 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:04:25.894465 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34d8388_f6d9_4608_996e_c3238f3886e6.slice/crio-51d97ccdbdfc2b00b777cc1d3caa17d6ac50d61d8b9ee7f4a9ce3501184c99b0 WatchSource:0}: Error finding container 51d97ccdbdfc2b00b777cc1d3caa17d6ac50d61d8b9ee7f4a9ce3501184c99b0: Status 404 returned error can't find the container with id 51d97ccdbdfc2b00b777cc1d3caa17d6ac50d61d8b9ee7f4a9ce3501184c99b0 Sep 13 19:04:26.318966 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:26.318721 2555 generic.go:356] "Generic (PLEG): container finished" podID="27e4d6d9-86bc-43ac-b5fa-158b3fef5498" containerID="b91fa080e4783f63052aa19a33a258b4c95759b301d940d559a687389c3fd2e8" exitCode=0 Sep 13 19:04:26.319151 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:26.318801 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" event={"ID":"27e4d6d9-86bc-43ac-b5fa-158b3fef5498","Type":"ContainerDied","Data":"b91fa080e4783f63052aa19a33a258b4c95759b301d940d559a687389c3fd2e8"} Sep 13 19:04:26.320075 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:26.320055 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7cw7l" event={"ID":"d34d8388-f6d9-4608-996e-c3238f3886e6","Type":"ContainerStarted","Data":"51d97ccdbdfc2b00b777cc1d3caa17d6ac50d61d8b9ee7f4a9ce3501184c99b0"} Sep 13 19:04:26.538725 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:26.538692 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:26.595255 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:26.595118 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:26.616162 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:26.616132 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:26.616318 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:26.616283 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:04:26.616362 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:26.616345 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:28.616326601 +0000 UTC m=+38.083887785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:04:27.325800 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:27.325762 2555 generic.go:356] "Generic (PLEG): container finished" podID="27e4d6d9-86bc-43ac-b5fa-158b3fef5498" containerID="258deea8349b2a1b34aaf4957d2faf3585029135ca595bffde1f01e575cbc39b" exitCode=0 Sep 13 19:04:27.326263 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:27.325811 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" event={"ID":"27e4d6d9-86bc-43ac-b5fa-158b3fef5498","Type":"ContainerDied","Data":"258deea8349b2a1b34aaf4957d2faf3585029135ca595bffde1f01e575cbc39b"} Sep 13 19:04:28.331807 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:28.331776 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" event={"ID":"27e4d6d9-86bc-43ac-b5fa-158b3fef5498","Type":"ContainerStarted","Data":"a978680ab0317744dde79c92b33be5f50c00de77208375ea3d44706f45e1ba87"} Sep 13 19:04:28.333262 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:28.333241 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7cw7l" event={"ID":"d34d8388-f6d9-4608-996e-c3238f3886e6","Type":"ContainerStarted","Data":"77bf06791fb9b3a5d3586637a4df93a0aedfd3092ef70cc173d0a73d167f3ddb"} Sep 13 19:04:28.353191 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:28.353118 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fbbq4" podStartSLOduration=8.767016831 podStartE2EDuration="37.353106031s" totalImagesPullingTime="28.5860892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:28.351763114 +0000 UTC m=+37.819324298" watchObservedRunningTime="2026-09-13 19:04:28.353106031 +0000 UTC m=+37.820667220" Sep 13 19:04:28.366401 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:28.366348 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7cw7l" podStartSLOduration=2.015873227 podStartE2EDuration="4.366330123s" totalImagesPullingTime="2.350456896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:04:28.365276951 +0000 UTC m=+37.832838142" watchObservedRunningTime="2026-09-13 19:04:28.366330123 +0000 UTC m=+37.833891314" Sep 13 19:04:28.477359 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:28.477328 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:28.525962 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:28.525898 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:28.631241 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:28.631211 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:28.631363 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:28.631346 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:04:28.631410 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:28.631403 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:32.631390275 +0000 UTC m=+42.098951446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:04:29.387456 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:29.387423 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:30.069484 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:30.069453 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:30.171180 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:30.171148 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:31.509041 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:31.509005 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:31.557091 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:31.557061 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:32.478238 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:32.478205 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:32.533127 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:32.533096 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:32.659367 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:32.659328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:32.659504 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:32.659482 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:04:32.659560 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:32.659551 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:40.659535442 +0000 UTC m=+50.127096613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:04:34.428272 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:34.428244 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:40.719009 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:40.718971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:40.719409 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:40.719137 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:04:40.719409 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:40.719206 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:04:56.719189721 +0000 UTC m=+66.186750893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:04:43.601597 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:43.601565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:44.513759 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:44.513726 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:44.614299 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:44.614269 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:46.564914 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:46.564877 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:46.620423 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:46.620395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:48.799169 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:48.799129 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:50.318675 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:50.318648 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-488kp" Sep 13 19:04:50.464376 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:50.464343 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:50.517240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:50.517207 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:04:56.724499 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.724457 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:56.724997 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.724517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:04:56.724997 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.724547 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:04:56.724997 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:56.724715 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:04:56.724997 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:56.724838 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:05:28.724815187 +0000 UTC m=+98.192376372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:04:56.727103 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.727081 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 13 19:04:56.727190 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.727104 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 13 19:04:56.735050 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:56.735034 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 19:04:56.735130 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:04:56.735091 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:06:00.735077686 +0000 UTC m=+130.202638858 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : secret "metrics-daemon-secret" not found Sep 13 19:04:56.736946 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.736931 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 13 19:04:56.748323 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.748294 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d2fs\" (UniqueName: \"kubernetes.io/projected/2b7f9cc2-4c61-418e-950f-6b12d94e85d0-kube-api-access-2d2fs\") pod \"network-check-target-zj48k\" (UID: \"2b7f9cc2-4c61-418e-950f-6b12d94e85d0\") " pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:56.817900 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.817875 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cs6ck\"" Sep 13 19:04:56.825198 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.825170 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:56.825198 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.825196 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:04:56.827509 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.827487 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 13 19:04:56.837336 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:56.837313 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c202984-6312-421c-8916-7cf331df8e91-original-pull-secret\") pod \"global-pull-secret-syncer-gptfs\" (UID: \"6c202984-6312-421c-8916-7cf331df8e91\") " pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:57.118453 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:57.118421 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zj48k"] Sep 13 19:04:57.121653 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:04:57.121626 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7f9cc2_4c61_418e_950f_6b12d94e85d0.slice/crio-3513231cce2b73138883fbb394c8178d74aedd2f6c197299eab650e9ad8324ac WatchSource:0}: Error finding container 3513231cce2b73138883fbb394c8178d74aedd2f6c197299eab650e9ad8324ac: Status 404 returned error can't find the container with id 3513231cce2b73138883fbb394c8178d74aedd2f6c197299eab650e9ad8324ac Sep 13 19:04:57.122354 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:57.122329 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gptfs" Sep 13 19:04:57.405268 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:57.405189 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zj48k" event={"ID":"2b7f9cc2-4c61-418e-950f-6b12d94e85d0","Type":"ContainerStarted","Data":"3513231cce2b73138883fbb394c8178d74aedd2f6c197299eab650e9ad8324ac"} Sep 13 19:04:57.410538 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:57.410510 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gptfs"] Sep 13 19:04:57.413806 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:04:57.413780 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c202984_6312_421c_8916_7cf331df8e91.slice/crio-a07ad02d8f5751fcf0c91f53d0b3c37522f4faba7387822b9c837aa9dd509c08 WatchSource:0}: Error finding container a07ad02d8f5751fcf0c91f53d0b3c37522f4faba7387822b9c837aa9dd509c08: Status 404 returned error can't find the container with id a07ad02d8f5751fcf0c91f53d0b3c37522f4faba7387822b9c837aa9dd509c08 Sep 13 19:04:58.409520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:04:58.409477 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gptfs" event={"ID":"6c202984-6312-421c-8916-7cf331df8e91","Type":"ContainerStarted","Data":"a07ad02d8f5751fcf0c91f53d0b3c37522f4faba7387822b9c837aa9dd509c08"} Sep 13 19:05:02.420984 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:02.420940 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zj48k" event={"ID":"2b7f9cc2-4c61-418e-950f-6b12d94e85d0","Type":"ContainerStarted","Data":"8cbcefa24e5ba7f7531053f93994b8bad0cbea73d04fb1e39b6ca90502d45c36"} Sep 13 19:05:02.421428 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:02.421009 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:05:02.422292 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:02.422269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gptfs" event={"ID":"6c202984-6312-421c-8916-7cf331df8e91","Type":"ContainerStarted","Data":"07167ce0f7daeb08fac911cdc40cdf2ac5bfdff1fd5bd8f83da574fbfa2b7a17"} Sep 13 19:05:02.435513 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:02.435458 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zj48k" podStartSLOduration=66.893967587 podStartE2EDuration="1m11.435442247s" totalImagesPullingTime="4.54147466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:05:02.435072987 +0000 UTC m=+71.902634175" watchObservedRunningTime="2026-09-13 19:05:02.435442247 +0000 UTC m=+71.903003433" Sep 13 19:05:10.599905 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:10.599870 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:05:10.650635 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:10.650605 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:05:19.134795 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.134634 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gptfs" podStartSLOduration=83.88180145 podStartE2EDuration="1m28.134615593s" totalImagesPullingTime="4.252814143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:05:02.451924402 +0000 UTC m=+71.919485592" watchObservedRunningTime="2026-09-13 19:05:19.134615593 +0000 UTC m=+88.602176792" Sep 13 19:05:19.135324 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.135088 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2"] Sep 13 19:05:19.139123 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.139105 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh"] Sep 13 19:05:19.139236 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.139219 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" Sep 13 19:05:19.141815 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.141790 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-z5m59\"" Sep 13 19:05:19.141925 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.141864 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.141990 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.141792 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 13 19:05:19.142285 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.142264 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 13 19:05:19.142706 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.142663 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 13 19:05:19.142837 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.142819 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 13 19:05:19.144098 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.144081 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 13 19:05:19.144379 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.144361 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 13 19:05:19.144788 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.144773 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 13 19:05:19.144862 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.144820 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 13 19:05:19.156183 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.156160 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2"] Sep 13 19:05:19.158508 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.158484 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh"] Sep 13 19:05:19.167736 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.167714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cmb8\" (UniqueName: \"kubernetes.io/projected/43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24-kube-api-access-7cmb8\") pod \"managed-serviceaccount-addon-agent-645f646bcd-94gm2\" (UID: \"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" Sep 13 19:05:19.167832 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.167742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.167832 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.167774 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/62001f75-33c3-4734-bb77-fc5b17cde81b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.167923 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.167834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-hub\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.167923 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.167861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.167923 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.167892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t527j\" (UniqueName: \"kubernetes.io/projected/62001f75-33c3-4734-bb77-fc5b17cde81b-kube-api-access-t527j\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.167923 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.167914 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-645f646bcd-94gm2\" (UID: \"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" Sep 13 19:05:19.168059 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.167939 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-ca\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.268885 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.268840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-ca\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.269064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.268894 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cmb8\" (UniqueName: \"kubernetes.io/projected/43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24-kube-api-access-7cmb8\") pod \"managed-serviceaccount-addon-agent-645f646bcd-94gm2\" (UID: \"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" Sep 13 19:05:19.269064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.268913 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.269064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.268946 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/62001f75-33c3-4734-bb77-fc5b17cde81b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.269064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.268972 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-hub\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.269064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.268991 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.269064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.269020 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t527j\" (UniqueName: \"kubernetes.io/projected/62001f75-33c3-4734-bb77-fc5b17cde81b-kube-api-access-t527j\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.269064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.269052 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-645f646bcd-94gm2\" (UID: \"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" Sep 13 19:05:19.269954 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.269931 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/62001f75-33c3-4734-bb77-fc5b17cde81b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.271653 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.271621 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.271874 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.271850 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-ca\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.271975 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.271958 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-645f646bcd-94gm2\" (UID: \"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" Sep 13 19:05:19.272040 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.271987 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.272040 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.272016 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/62001f75-33c3-4734-bb77-fc5b17cde81b-hub\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.276230 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.276205 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t527j\" (UniqueName: \"kubernetes.io/projected/62001f75-33c3-4734-bb77-fc5b17cde81b-kube-api-access-t527j\") pod \"cluster-proxy-proxy-agent-864d6d8f4b-l4hmh\" (UID: \"62001f75-33c3-4734-bb77-fc5b17cde81b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.276337 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.276316 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cmb8\" (UniqueName: \"kubernetes.io/projected/43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24-kube-api-access-7cmb8\") pod \"managed-serviceaccount-addon-agent-645f646bcd-94gm2\" (UID: \"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" Sep 13 19:05:19.458015 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.457922 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" Sep 13 19:05:19.463929 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.463907 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:05:19.725198 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.725172 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2"] Sep 13 19:05:19.727542 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:05:19.727509 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43a09f6c_ee09_4a5b_b5e4_e83e68ed5b24.slice/crio-7557cec16d6f1aa37dfe173520fc5822c3f4a45362a43c47166e2f9a602414ce WatchSource:0}: Error finding container 7557cec16d6f1aa37dfe173520fc5822c3f4a45362a43c47166e2f9a602414ce: Status 404 returned error can't find the container with id 7557cec16d6f1aa37dfe173520fc5822c3f4a45362a43c47166e2f9a602414ce Sep 13 19:05:19.730012 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:19.729992 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh"] Sep 13 19:05:19.732548 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:05:19.732489 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62001f75_33c3_4734_bb77_fc5b17cde81b.slice/crio-99c69b9faab008e71ac6a898a7385d4c378c246ab168913e2bc56b07c63e23af WatchSource:0}: Error finding container 99c69b9faab008e71ac6a898a7385d4c378c246ab168913e2bc56b07c63e23af: Status 404 returned error can't find the container with id 99c69b9faab008e71ac6a898a7385d4c378c246ab168913e2bc56b07c63e23af Sep 13 19:05:20.467480 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:20.467441 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" event={"ID":"62001f75-33c3-4734-bb77-fc5b17cde81b","Type":"ContainerStarted","Data":"99c69b9faab008e71ac6a898a7385d4c378c246ab168913e2bc56b07c63e23af"} Sep 13 19:05:20.469047 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:20.469022 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" event={"ID":"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24","Type":"ContainerStarted","Data":"7557cec16d6f1aa37dfe173520fc5822c3f4a45362a43c47166e2f9a602414ce"} Sep 13 19:05:22.475514 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:22.475426 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" event={"ID":"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24","Type":"ContainerStarted","Data":"13da990b54cb34a15cebc6d4617755621c1a3e094e13206dd58570615c327002"} Sep 13 19:05:22.489820 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:22.489776 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" podStartSLOduration=1.149854324 podStartE2EDuration="3.489762046s" totalImagesPullingTime="2.339907722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:05:22.489302497 +0000 UTC m=+91.956863686" watchObservedRunningTime="2026-09-13 19:05:22.489762046 +0000 UTC m=+91.957323234" Sep 13 19:05:28.730307 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:28.730265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:05:28.730777 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:05:28.730405 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:05:28.730777 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:05:28.730482 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:06:32.73046534 +0000 UTC m=+162.198026506 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:05:33.427937 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:33.427899 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zj48k" Sep 13 19:05:37.518890 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:37.518853 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" event={"ID":"62001f75-33c3-4734-bb77-fc5b17cde81b","Type":"ContainerStarted","Data":"b82318d8cff3bab0f978e86fa0e0c638605cdb539368f37b9b046e28d8313e85"} Sep 13 19:05:37.519285 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:37.518902 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" event={"ID":"62001f75-33c3-4734-bb77-fc5b17cde81b","Type":"ContainerStarted","Data":"a8020944c0c7dc57df00b222497f9fbdd1dc19950fa3aa37ab5f563a7ccb1a56"} Sep 13 19:05:37.519285 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:37.518920 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" event={"ID":"62001f75-33c3-4734-bb77-fc5b17cde81b","Type":"ContainerStarted","Data":"be26e033d8a6e8f3628160cde34dfb881f2234fcac91c0d91b0fc5033064b0c0"} Sep 13 19:05:37.536616 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:05:37.536570 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" podStartSLOduration=1.625831735 podStartE2EDuration="18.536556659s" totalImagesPullingTime="16.910724924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:05:37.535342634 +0000 UTC m=+107.002903825" watchObservedRunningTime="2026-09-13 19:05:37.536556659 +0000 UTC m=+107.004117848" Sep 13 19:06:00.753532 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:06:00.753492 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:06:00.754082 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:06:00.753626 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 19:06:00.754082 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:06:00.753717 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:08:02.75369577 +0000 UTC m=+252.221256950 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : secret "metrics-daemon-secret" not found Sep 13 19:06:27.934979 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:06:27.934938 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-96g96" podUID="2bc80f67-6120-4bb9-97f1-4d4802174ba2" Sep 13 19:06:28.029728 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:06:28.029673 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:06:28.665946 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:06:28.665913 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-96g96" Sep 13 19:06:32.766292 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:06:32.766243 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:06:32.766703 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:06:32.766384 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 19:06:32.766703 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:06:32.766445 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls podName:2bc80f67-6120-4bb9-97f1-4d4802174ba2 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:34.766431168 +0000 UTC m=+284.233992340 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls") pod "dns-default-96g96" (UID: "2bc80f67-6120-4bb9-97f1-4d4802174ba2") : secret "dns-default-metrics-tls" not found Sep 13 19:06:39.004000 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:06:39.003967 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:07:22.823547 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:07:22.823512 2555 generic.go:356] "Generic (PLEG): container finished" podID="43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24" containerID="13da990b54cb34a15cebc6d4617755621c1a3e094e13206dd58570615c327002" exitCode=255 Sep 13 19:07:22.823963 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:07:22.823583 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" event={"ID":"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24","Type":"ContainerDied","Data":"13da990b54cb34a15cebc6d4617755621c1a3e094e13206dd58570615c327002"} Sep 13 19:07:22.823963 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:07:22.823886 2555 scope.go:117] "RemoveContainer" containerID="13da990b54cb34a15cebc6d4617755621c1a3e094e13206dd58570615c327002" Sep 13 19:07:23.828858 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:07:23.828824 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645f646bcd-94gm2" event={"ID":"43a09f6c-ee09-4a5b-b5e4-e83e68ed5b24","Type":"ContainerStarted","Data":"2ec10c9e37a715704f2aeb945e1b0b0a9717a7ace847a7e92e64b6a0a37c463d"} Sep 13 19:07:38.179338 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:07:38.179307 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:02.849601 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:02.849553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:08:02.850009 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:02.849668 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 19:08:02.850009 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:02.849738 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs podName:597e5ef6-551e-4d79-abf3-59e08bb4565e nodeName:}" failed. No retries permitted until 2026-09-13 19:10:04.849723437 +0000 UTC m=+374.317284609 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs") pod "network-metrics-daemon-q7q4c" (UID: "597e5ef6-551e-4d79-abf3-59e08bb4565e") : secret "metrics-daemon-secret" not found Sep 13 19:08:02.893164 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:02.893135 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:02.948203 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:02.948174 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:06.041530 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.041496 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:06.142361 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.142329 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:06.615822 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.615795 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:06.659731 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.659706 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:06.770413 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.770384 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n8xdq"] Sep 13 19:08:06.773314 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.773293 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.776089 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.776062 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 13 19:08:06.776185 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.776069 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 13 19:08:06.776185 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.776129 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 13 19:08:06.776185 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.776154 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9flm9\"" Sep 13 19:08:06.777522 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.777498 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 13 19:08:06.778898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.778864 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:06.785848 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.785818 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n8xdq"] Sep 13 19:08:06.832994 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.832967 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:06.879207 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.879146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77d5c99b-a0d9-44e8-ae24-11819282cb53-data-volume\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.879207 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.879185 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.879333 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.879215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.879333 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.879274 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77d5c99b-a0d9-44e8-ae24-11819282cb53-crio-socket\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.879333 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.879290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77kc9\" (UniqueName: \"kubernetes.io/projected/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-api-access-77kc9\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.979608 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.979575 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77d5c99b-a0d9-44e8-ae24-11819282cb53-data-volume\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.979608 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.979606 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.979894 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.979630 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.979894 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.979654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77d5c99b-a0d9-44e8-ae24-11819282cb53-crio-socket\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.979894 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.979672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77kc9\" (UniqueName: \"kubernetes.io/projected/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-api-access-77kc9\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.979894 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:06.979725 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 19:08:06.979894 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.979759 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77d5c99b-a0d9-44e8-ae24-11819282cb53-crio-socket\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.979894 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:06.979775 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 19:08:06.979894 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:06.979797 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:07.479779478 +0000 UTC m=+256.947340662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : configmap "kube-rbac-proxy" not found Sep 13 19:08:06.979894 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:06.979850 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:07.479831004 +0000 UTC m=+256.947392178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : secret "insights-runtime-extractor-tls" not found Sep 13 19:08:06.980144 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.979913 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77d5c99b-a0d9-44e8-ae24-11819282cb53-data-volume\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:06.987803 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:06.987771 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77kc9\" (UniqueName: \"kubernetes.io/projected/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-api-access-77kc9\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:07.040324 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:07.040297 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:07.318442 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:07.318417 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:07.423287 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:07.423259 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:07.483075 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:07.483048 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:07.483207 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:07.483084 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:07.483207 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:07.483161 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 19:08:07.483207 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:07.483178 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 19:08:07.483333 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:07.483234 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:08.483218112 +0000 UTC m=+257.950779283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : secret "insights-runtime-extractor-tls" not found Sep 13 19:08:07.483333 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:07.483251 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:08.483242918 +0000 UTC m=+257.950804100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : configmap "kube-rbac-proxy" not found Sep 13 19:08:07.483834 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:07.483818 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:07.584521 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:07.584461 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:08.489023 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:08.488979 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:08.489423 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:08.489065 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:08.489423 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:08.489131 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 19:08:08.489423 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:08.489135 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 19:08:08.489423 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:08.489233 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:10.489200931 +0000 UTC m=+259.956762098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : secret "insights-runtime-extractor-tls" not found Sep 13 19:08:08.489423 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:08.489271 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:10.489257811 +0000 UTC m=+259.956818982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : configmap "kube-rbac-proxy" not found Sep 13 19:08:08.731988 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:08.731963 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t4xtb_a926d14e-1f9e-44e9-99b8-4f78d24c5b43/dns-node-resolver/0.log" Sep 13 19:08:08.948427 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:08.948395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:08.997091 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:08.997058 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:09.834581 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:09.834544 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:09.932759 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:09.932737 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rj9p8_a8e1575a-c34e-41c5-a3c7-735fdbda759f/node-ca/0.log" Sep 13 19:08:10.503786 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:10.503752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:10.503946 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:10.503821 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:10.503946 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:10.503881 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 19:08:10.503946 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:10.503898 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 19:08:10.503946 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:10.503934 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:14.503920918 +0000 UTC m=+263.971482086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : configmap "kube-rbac-proxy" not found Sep 13 19:08:10.503946 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:10.503947 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:14.503941562 +0000 UTC m=+263.971502729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : secret "insights-runtime-extractor-tls" not found Sep 13 19:08:10.532399 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:10.532374 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7cw7l_d34d8388-f6d9-4608-996e-c3238f3886e6/serve-healthcheck-canary/0.log" Sep 13 19:08:12.542378 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:12.542342 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:12.874612 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:12.874539 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:12.996619 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:12.996590 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:13.096550 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:13.096525 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:13.196936 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:13.196865 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:13.247407 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:13.247382 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:13.564276 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:13.564248 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:14.531875 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:14.531838 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:14.531875 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:14.531879 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:14.532092 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:14.531953 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 19:08:14.532092 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:14.531968 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 19:08:14.532092 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:14.532023 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:22.532007643 +0000 UTC m=+271.999568826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : configmap "kube-rbac-proxy" not found Sep 13 19:08:14.532092 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:14.532038 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:22.532032906 +0000 UTC m=+271.999594090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : secret "insights-runtime-extractor-tls" not found Sep 13 19:08:14.559445 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:14.559422 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:14.761515 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:14.761482 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:15.171852 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:15.171819 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:15.360200 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:15.360163 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:15.762521 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:15.762488 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:15.893294 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:15.893267 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:16.165955 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:16.165874 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:16.624704 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:16.624655 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:16.755335 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:16.755302 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:16.961076 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:16.960998 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:17.164502 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:17.164474 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:17.560775 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:17.560750 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:17.759560 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:17.759532 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:17.963347 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:17.963279 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:18.963862 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:18.963825 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:19.342540 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:19.342510 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:19.392030 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:19.392004 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:19.564327 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:19.564296 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:19.761617 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:19.761592 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:19.964236 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:19.962222 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:20.025146 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:20.025072 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:20.955499 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:20.955453 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:21.163266 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:21.163238 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:21.562212 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:21.562183 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:21.757106 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:21.757069 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:22.356939 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:22.356907 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:22.588150 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:22.588120 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:22.588326 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:22.588166 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:22.588326 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:22.588265 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 19:08:22.588447 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:22.588328 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls podName:77d5c99b-a0d9-44e8-ae24-11819282cb53 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:38.588311653 +0000 UTC m=+288.055872843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n8xdq" (UID: "77d5c99b-a0d9-44e8-ae24-11819282cb53") : secret "insights-runtime-extractor-tls" not found Sep 13 19:08:22.588729 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:22.588672 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77d5c99b-a0d9-44e8-ae24-11819282cb53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:22.757233 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:22.757205 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:22.964426 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:22.964395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:23.356079 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:23.356050 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:23.567464 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:23.567433 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:27.780161 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:27.780124 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:27.869519 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:27.869490 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:27.982724 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:27.982696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:28.058175 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:28.058106 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:28.107807 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:28.107784 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:28.260557 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:28.260525 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:28.642832 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:28.642803 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:29.038720 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:29.038675 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:29.139419 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:29.139390 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:29.242578 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:29.242550 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:29.325979 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:29.325918 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:29.651313 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:29.651239 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:29.857522 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:29.857498 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:29.962503 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:29.962442 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:30.071848 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:30.071823 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:30.121975 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:30.121951 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:31.070099 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:31.070069 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:31.170753 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:31.170719 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:31.270633 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:31.270603 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:31.667211 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:31.667175 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-96g96" podUID="2bc80f67-6120-4bb9-97f1-4d4802174ba2" Sep 13 19:08:32.017591 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:32.017563 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-96g96" Sep 13 19:08:34.774389 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:34.774357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:08:34.776584 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:34.776562 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bc80f67-6120-4bb9-97f1-4d4802174ba2-metrics-tls\") pod \"dns-default-96g96\" (UID: \"2bc80f67-6120-4bb9-97f1-4d4802174ba2\") " pod="openshift-dns/dns-default-96g96" Sep 13 19:08:35.021003 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:35.020976 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kkpnt\"" Sep 13 19:08:35.029415 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:35.029361 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-96g96" Sep 13 19:08:35.293377 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:35.293307 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-96g96"] Sep 13 19:08:35.296339 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:08:35.296312 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc80f67_6120_4bb9_97f1_4d4802174ba2.slice/crio-3e31158c5f704b33562d4529bfb19d20cc16c619c92d66555d884c177e2b7103 WatchSource:0}: Error finding container 3e31158c5f704b33562d4529bfb19d20cc16c619c92d66555d884c177e2b7103: Status 404 returned error can't find the container with id 3e31158c5f704b33562d4529bfb19d20cc16c619c92d66555d884c177e2b7103 Sep 13 19:08:36.029284 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:36.029246 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-96g96" event={"ID":"2bc80f67-6120-4bb9-97f1-4d4802174ba2","Type":"ContainerStarted","Data":"3e31158c5f704b33562d4529bfb19d20cc16c619c92d66555d884c177e2b7103"} Sep 13 19:08:37.034382 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:37.034348 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-96g96" event={"ID":"2bc80f67-6120-4bb9-97f1-4d4802174ba2","Type":"ContainerStarted","Data":"3c809f999dda5070af11dfd451590603efb1a4ed3e88f7d350013b7cb0e6d2de"} Sep 13 19:08:37.292738 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:37.292706 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:37.394373 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:37.394344 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:37.473449 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:37.473424 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:37.758834 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:37.758804 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:38.039383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:38.039308 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-96g96" event={"ID":"2bc80f67-6120-4bb9-97f1-4d4802174ba2","Type":"ContainerStarted","Data":"0798c275599e0ee5a6fd58c046e0dd8c87af691a74509daf960ff765fb83db3f"} Sep 13 19:08:38.039830 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:38.039428 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-96g96" Sep 13 19:08:38.054793 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:38.054753 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-96g96" podStartSLOduration=252.43080605 podStartE2EDuration="4m14.054741034s" totalImagesPullingTime="1.623934984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:08:38.053825707 +0000 UTC m=+287.521386896" watchObservedRunningTime="2026-09-13 19:08:38.054741034 +0000 UTC m=+287.522302223" Sep 13 19:08:38.601717 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:38.601662 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:38.603823 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:38.603794 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77d5c99b-a0d9-44e8-ae24-11819282cb53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8xdq\" (UID: \"77d5c99b-a0d9-44e8-ae24-11819282cb53\") " pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:38.887801 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:38.887719 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n8xdq" Sep 13 19:08:39.153781 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.153715 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n8xdq"] Sep 13 19:08:39.156692 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:08:39.156657 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d5c99b_a0d9_44e8_ae24_11819282cb53.slice/crio-dcabd5f35d85684acd63792446884d8167a909c8bc8badfcd6557c4c5bf9786b WatchSource:0}: Error finding container dcabd5f35d85684acd63792446884d8167a909c8bc8badfcd6557c4c5bf9786b: Status 404 returned error can't find the container with id dcabd5f35d85684acd63792446884d8167a909c8bc8badfcd6557c4c5bf9786b Sep 13 19:08:39.676470 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.676437 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7996bf64f8-5xfx6"] Sep 13 19:08:39.679502 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.679480 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.682396 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.682375 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 13 19:08:39.683336 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.683317 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 13 19:08:39.683434 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.683334 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 13 19:08:39.683662 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.683644 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 13 19:08:39.683762 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.683702 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 13 19:08:39.683762 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.683749 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 13 19:08:39.683884 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.683776 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hg8ww\"" Sep 13 19:08:39.684026 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.684008 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 13 19:08:39.689624 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.689590 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7996bf64f8-5xfx6"] Sep 13 19:08:39.809497 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.809475 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwn7p\" (UniqueName: \"kubernetes.io/projected/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-kube-api-access-qwn7p\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.809578 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.809505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-oauth-serving-cert\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.809578 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.809526 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-service-ca\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.809658 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.809595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-serving-cert\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.809658 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.809619 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-oauth-config\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.809658 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.809650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-config\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910068 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwn7p\" (UniqueName: \"kubernetes.io/projected/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-kube-api-access-qwn7p\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910068 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-oauth-serving-cert\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910234 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910087 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-service-ca\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910303 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910283 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-serving-cert\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910358 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910315 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-oauth-config\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910358 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910340 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-config\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910632 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910616 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-service-ca\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910803 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910773 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-oauth-serving-cert\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.910959 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.910943 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-config\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.912615 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.912593 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-serving-cert\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.912877 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.912859 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-oauth-config\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.919154 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.919131 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwn7p\" (UniqueName: \"kubernetes.io/projected/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-kube-api-access-qwn7p\") pod \"console-7996bf64f8-5xfx6\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:39.990164 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:39.990112 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:40.047819 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.047791 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8xdq" event={"ID":"77d5c99b-a0d9-44e8-ae24-11819282cb53","Type":"ContainerStarted","Data":"dc556cd4f194936cd76c35f76c926fcb258a9cbe9ba4a4a96e2318a50bf9bc5f"} Sep 13 19:08:40.047926 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.047847 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8xdq" event={"ID":"77d5c99b-a0d9-44e8-ae24-11819282cb53","Type":"ContainerStarted","Data":"589057935c8d6f9f46251c8a6b2ff5b6251537ae7779d1da13d795656278e7ac"} Sep 13 19:08:40.047926 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.047866 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8xdq" event={"ID":"77d5c99b-a0d9-44e8-ae24-11819282cb53","Type":"ContainerStarted","Data":"dcabd5f35d85684acd63792446884d8167a909c8bc8badfcd6557c4c5bf9786b"} Sep 13 19:08:40.260066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.260029 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7996bf64f8-5xfx6"] Sep 13 19:08:40.263469 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:08:40.263441 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e80c57_8f8e_4e6b_81a7_6612aa719b46.slice/crio-87f3a631de9c3599c8f88a416128ea926d6c98c1a3d64ca6a1cb48aa09d2d342 WatchSource:0}: Error finding container 87f3a631de9c3599c8f88a416128ea926d6c98c1a3d64ca6a1cb48aa09d2d342: Status 404 returned error can't find the container with id 87f3a631de9c3599c8f88a416128ea926d6c98c1a3d64ca6a1cb48aa09d2d342 Sep 13 19:08:40.468232 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.468198 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:40.531646 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.531569 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:40.716459 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.716427 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:40.896994 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.896891 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:40.946863 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:40.946830 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:41.053725 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:41.053667 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7996bf64f8-5xfx6" event={"ID":"e6e80c57-8f8e-4e6b-81a7-6612aa719b46","Type":"ContainerStarted","Data":"87f3a631de9c3599c8f88a416128ea926d6c98c1a3d64ca6a1cb48aa09d2d342"} Sep 13 19:08:42.004379 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:42.004337 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q7q4c" podUID="597e5ef6-551e-4d79-abf3-59e08bb4565e" Sep 13 19:08:42.058878 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:42.058842 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8xdq" event={"ID":"77d5c99b-a0d9-44e8-ae24-11819282cb53","Type":"ContainerStarted","Data":"66ca3f03c104894d0516eb60e11b424cf5f569d13616a05eae2c98a61e804157"} Sep 13 19:08:42.081008 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:42.080954 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n8xdq" podStartSLOduration=34.179752765 podStartE2EDuration="36.080938381s" totalImagesPullingTime="1.901185616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:08:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:08:42.079378062 +0000 UTC m=+291.546939253" watchObservedRunningTime="2026-09-13 19:08:42.080938381 +0000 UTC m=+291.548499569" Sep 13 19:08:42.939400 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:42.939369 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:44.066875 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.066838 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7996bf64f8-5xfx6" event={"ID":"e6e80c57-8f8e-4e6b-81a7-6612aa719b46","Type":"ContainerStarted","Data":"f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2"} Sep 13 19:08:44.083339 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.083290 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7996bf64f8-5xfx6" podStartSLOduration=2.247360665 podStartE2EDuration="5.083274652s" totalImagesPullingTime="2.835913987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:08:44.081768549 +0000 UTC m=+293.549329740" watchObservedRunningTime="2026-09-13 19:08:44.083274652 +0000 UTC m=+293.550835841" Sep 13 19:08:44.587442 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.587373 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:44.795038 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.795005 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:44.836618 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.836591 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg"] Sep 13 19:08:44.839695 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.839634 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:44.842273 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.842252 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 13 19:08:44.842375 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.842353 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 13 19:08:44.843309 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.843281 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 13 19:08:44.843309 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.843295 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m6dtd\"" Sep 13 19:08:44.843479 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.843432 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 13 19:08:44.843570 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.843551 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 13 19:08:44.843657 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.843608 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 13 19:08:44.849251 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.849231 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-947g8"] Sep 13 19:08:44.852293 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.852272 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.852893 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.852874 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg"] Sep 13 19:08:44.854616 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.854596 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 13 19:08:44.854732 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.854640 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dtclt\"" Sep 13 19:08:44.854732 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.854646 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 13 19:08:44.854732 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.854650 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 13 19:08:44.880612 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.880588 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:44.933298 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.933279 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:44.952375 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-tls\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.952459 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952392 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8021a7af-e0df-4909-aaab-54a9f311dfa2-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:44.952459 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-root\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.952531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952484 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x2p6\" (UniqueName: \"kubernetes.io/projected/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-api-access-5x2p6\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:44.952531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.952608 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:44.952608 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-wtmp\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.952608 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952566 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-metrics-client-ca\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.952608 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952593 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-textfile\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.952769 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952636 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:44.952769 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:44.952769 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952667 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8021a7af-e0df-4909-aaab-54a9f311dfa2-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:44.952769 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-sys\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.952769 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-accelerators-collector-config\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:44.952769 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:44.952739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k79r8\" (UniqueName: \"kubernetes.io/projected/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-kube-api-access-k79r8\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.035032 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.035005 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:45.053985 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.053957 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.053991 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.054064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054008 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-wtmp\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054022 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-metrics-client-ca\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054064 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054037 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-textfile\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:45.054105 2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054118 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8021a7af-e0df-4909-aaab-54a9f311dfa2-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054147 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-sys\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:08:45.054162 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-tls podName:8021a7af-e0df-4909-aaab-54a9f311dfa2 nodeName:}" failed. No retries permitted until 2026-09-13 19:08:45.554144686 +0000 UTC m=+295.021705859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-97rzg" (UID: "8021a7af-e0df-4909-aaab-54a9f311dfa2") : secret "kube-state-metrics-tls" not found Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054168 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-wtmp\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054189 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-sys\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054225 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054195 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-accelerators-collector-config\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054647 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054523 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-textfile\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054647 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054638 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k79r8\" (UniqueName: \"kubernetes.io/projected/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-kube-api-access-k79r8\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054782 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054712 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-tls\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054782 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054756 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8021a7af-e0df-4909-aaab-54a9f311dfa2-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.054782 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054763 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-metrics-client-ca\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054936 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054784 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-root\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054936 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054827 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-root\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054936 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x2p6\" (UniqueName: \"kubernetes.io/projected/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-api-access-5x2p6\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.054936 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054871 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-accelerators-collector-config\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.054936 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054904 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8021a7af-e0df-4909-aaab-54a9f311dfa2-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.055135 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.054959 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.055182 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.055156 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8021a7af-e0df-4909-aaab-54a9f311dfa2-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.056909 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.056890 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.057056 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.057033 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-node-exporter-tls\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.057114 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.057088 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.064342 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.064319 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k79r8\" (UniqueName: \"kubernetes.io/projected/1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c-kube-api-access-k79r8\") pod \"node-exporter-947g8\" (UID: \"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c\") " pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.064446 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.064342 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x2p6\" (UniqueName: \"kubernetes.io/projected/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-api-access-5x2p6\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.134496 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.134443 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:45.161757 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.161736 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-947g8" Sep 13 19:08:45.173585 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:08:45.173564 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5bfa11_e50b_4f78_a2d0_0ed8e4f5359c.slice/crio-faf7e890125bb49d2a1c5ad6e96545a674bd570ae5ef6b81567f6836140dc210 WatchSource:0}: Error finding container faf7e890125bb49d2a1c5ad6e96545a674bd570ae5ef6b81567f6836140dc210: Status 404 returned error can't find the container with id faf7e890125bb49d2a1c5ad6e96545a674bd570ae5ef6b81567f6836140dc210 Sep 13 19:08:45.195092 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.195072 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:45.253820 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.253796 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:45.560256 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.560217 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.562520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.562501 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8021a7af-e0df-4909-aaab-54a9f311dfa2-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-97rzg\" (UID: \"8021a7af-e0df-4909-aaab-54a9f311dfa2\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.749497 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.749463 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" Sep 13 19:08:45.847734 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.847591 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:45.930699 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:45.930657 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:46.029623 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:46.029589 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg"] Sep 13 19:08:46.074573 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:46.074546 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-947g8" event={"ID":"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c","Type":"ContainerStarted","Data":"faf7e890125bb49d2a1c5ad6e96545a674bd570ae5ef6b81567f6836140dc210"} Sep 13 19:08:46.198878 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:08:46.198812 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8021a7af_e0df_4909_aaab_54a9f311dfa2.slice/crio-6d408290a602fa95bb568fc003a9ab29f450f8c5c400f0db31635bc112ba6956 WatchSource:0}: Error finding container 6d408290a602fa95bb568fc003a9ab29f450f8c5c400f0db31635bc112ba6956: Status 404 returned error can't find the container with id 6d408290a602fa95bb568fc003a9ab29f450f8c5c400f0db31635bc112ba6956 Sep 13 19:08:46.285309 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:46.285283 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:47.078842 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:47.078812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" event={"ID":"8021a7af-e0df-4909-aaab-54a9f311dfa2","Type":"ContainerStarted","Data":"6d408290a602fa95bb568fc003a9ab29f450f8c5c400f0db31635bc112ba6956"} Sep 13 19:08:47.080565 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:47.080537 2555 generic.go:356] "Generic (PLEG): container finished" podID="1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c" containerID="52e0f3c19c6ecc53e9e75b312b886b511f0d395f8ce63c8e03d56744f310dae4" exitCode=0 Sep 13 19:08:47.080688 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:47.080576 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-947g8" event={"ID":"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c","Type":"ContainerDied","Data":"52e0f3c19c6ecc53e9e75b312b886b511f0d395f8ce63c8e03d56744f310dae4"} Sep 13 19:08:47.762884 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:47.762851 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:48.044866 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.044786 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-96g96" Sep 13 19:08:48.086334 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.086299 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-947g8" event={"ID":"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c","Type":"ContainerStarted","Data":"d49064c415c1b00472c65d81569d7ebabb55f65bea1a701f34975169fd0db157"} Sep 13 19:08:48.086503 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.086351 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-947g8" event={"ID":"1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c","Type":"ContainerStarted","Data":"72cd2f777eef801b446432d1296eaaf1666e303f62585501339bb67b15aed2b8"} Sep 13 19:08:48.088717 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.088670 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" event={"ID":"8021a7af-e0df-4909-aaab-54a9f311dfa2","Type":"ContainerStarted","Data":"f78486e6acb8ea8eaff5f0ec00df53ef275ab80d4d2017351ea071c9c5ee82c7"} Sep 13 19:08:48.088837 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.088743 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" event={"ID":"8021a7af-e0df-4909-aaab-54a9f311dfa2","Type":"ContainerStarted","Data":"c48c1c550ec57107d3a32cc9b7cba33650052abeec89c1d96a4262c5f03d541a"} Sep 13 19:08:48.088837 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.088777 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" event={"ID":"8021a7af-e0df-4909-aaab-54a9f311dfa2","Type":"ContainerStarted","Data":"fd7c44106c44ca35d2e4446f40a7b2bf4b1fe548fd11a71454dcc4b662b286f6"} Sep 13 19:08:48.104111 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.104066 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-947g8" podStartSLOduration=2.979817931 podStartE2EDuration="4.104052551s" totalImagesPullingTime="1.06566329s" totalInitContainerRuntime="58.57133ms" isStatefulPod=true podCreationTimestamp="2026-09-13 19:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:08:48.10294182 +0000 UTC m=+297.570503036" watchObservedRunningTime="2026-09-13 19:08:48.104052551 +0000 UTC m=+297.571613734" Sep 13 19:08:48.118947 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.118909 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-97rzg" podStartSLOduration=2.925436405 podStartE2EDuration="4.118892317s" totalImagesPullingTime="1.193455912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:08:48.118180868 +0000 UTC m=+297.585742057" watchObservedRunningTime="2026-09-13 19:08:48.118892317 +0000 UTC m=+297.586453506" Sep 13 19:08:48.876298 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:48.876262 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:49.627122 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.627092 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:49.650809 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.650776 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j"] Sep 13 19:08:49.653877 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.653858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:49.656121 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.656105 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 13 19:08:49.656225 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.656210 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-j6p4t\"" Sep 13 19:08:49.661048 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.661020 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j"] Sep 13 19:08:49.682420 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.682365 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:49.790415 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.790387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3bde8337-455a-4472-9028-c164d7680a09-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8s74j\" (UID: \"3bde8337-455a-4472-9028-c164d7680a09\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:49.790500 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.790414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78fhg\" (UniqueName: \"kubernetes.io/projected/3bde8337-455a-4472-9028-c164d7680a09-kube-api-access-78fhg\") pod \"monitoring-plugin-5d85778b9d-8s74j\" (UID: \"3bde8337-455a-4472-9028-c164d7680a09\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:49.836304 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.836282 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:49.890957 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.890905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3bde8337-455a-4472-9028-c164d7680a09-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8s74j\" (UID: \"3bde8337-455a-4472-9028-c164d7680a09\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:49.890957 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.890934 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78fhg\" (UniqueName: \"kubernetes.io/projected/3bde8337-455a-4472-9028-c164d7680a09-kube-api-access-78fhg\") pod \"monitoring-plugin-5d85778b9d-8s74j\" (UID: \"3bde8337-455a-4472-9028-c164d7680a09\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:49.893131 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.893113 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3bde8337-455a-4472-9028-c164d7680a09-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8s74j\" (UID: \"3bde8337-455a-4472-9028-c164d7680a09\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:49.898430 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.898409 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78fhg\" (UniqueName: \"kubernetes.io/projected/3bde8337-455a-4472-9028-c164d7680a09-kube-api-access-78fhg\") pod \"monitoring-plugin-5d85778b9d-8s74j\" (UID: \"3bde8337-455a-4472-9028-c164d7680a09\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:49.963361 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.963340 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:49.991282 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.991256 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:49.991372 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.991317 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:49.996220 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:49.996201 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:50.099492 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:50.099463 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:08:50.173058 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:50.172995 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:50.235990 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:50.235970 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j"] Sep 13 19:08:50.238050 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:50.238023 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:50.238355 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:08:50.238333 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bde8337_455a_4472_9028_c164d7680a09.slice/crio-aa2cd3ce3fcbcf151fa8527d5baaa61cbe7005202d142b16c2f0b4caaec36750 WatchSource:0}: Error finding container aa2cd3ce3fcbcf151fa8527d5baaa61cbe7005202d142b16c2f0b4caaec36750: Status 404 returned error can't find the container with id aa2cd3ce3fcbcf151fa8527d5baaa61cbe7005202d142b16c2f0b4caaec36750 Sep 13 19:08:50.300174 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:50.300148 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:50.348376 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:50.348348 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:50.985522 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:50.985498 2555 kubelet.go:1648] "Image garbage collection succeeded" Sep 13 19:08:51.018329 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:51.018285 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:51.099381 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:51.099346 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" event={"ID":"3bde8337-455a-4472-9028-c164d7680a09","Type":"ContainerStarted","Data":"aa2cd3ce3fcbcf151fa8527d5baaa61cbe7005202d142b16c2f0b4caaec36750"} Sep 13 19:08:51.229531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:51.229497 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:51.329042 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:51.329001 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:52.089460 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:52.089427 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:52.104265 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:52.104233 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" event={"ID":"3bde8337-455a-4472-9028-c164d7680a09","Type":"ContainerStarted","Data":"80ee5f80d9ea2c9ad4a6a6182e4ae627ec64d827d5bd71a8f6d9a916857f5b42"} Sep 13 19:08:52.104568 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:52.104544 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:52.108853 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:52.108828 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" Sep 13 19:08:52.121375 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:52.121335 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8s74j" podStartSLOduration=1.739964048 podStartE2EDuration="3.121322265s" totalImagesPullingTime="1.381358217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:08:52.120433673 +0000 UTC m=+301.587994862" watchObservedRunningTime="2026-09-13 19:08:52.121322265 +0000 UTC m=+301.588883454" Sep 13 19:08:52.190974 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:52.190953 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:52.290519 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:52.290477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:54.003855 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:54.003824 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:08:55.869819 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:55.869786 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:55.920417 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:55.920389 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:58.323593 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:58.323565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:08:58.372928 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:08:58.372903 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:00.676422 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:00.676385 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:00.776926 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:00.776882 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:01.281171 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:01.281140 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7996bf64f8-5xfx6"] Sep 13 19:09:02.910692 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:02.910663 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:02.963513 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:02.963491 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:03.669904 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:03.669870 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:03.719812 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:03.719783 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:03.812746 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:03.812720 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:03.861773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:03.861751 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:07.122791 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:07.122756 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:07.226534 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:07.226475 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:12.886876 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:12.886845 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:12.939836 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:12.939804 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:15.075716 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:15.075669 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:15.124725 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:15.124698 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:18.344382 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:18.344352 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:18.447570 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:18.447534 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:26.299778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.299720 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7996bf64f8-5xfx6" podUID="e6e80c57-8f8e-4e6b-81a7-6612aa719b46" containerName="console" containerID="cri-o://f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2" gracePeriod=15 Sep 13 19:09:26.539901 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.539878 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:09:26.636552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.636461 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-oauth-serving-cert\") pod \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " Sep 13 19:09:26.636552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.636515 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-config\") pod \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " Sep 13 19:09:26.636552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.636548 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-service-ca\") pod \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " Sep 13 19:09:26.636866 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.636580 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwn7p\" (UniqueName: \"kubernetes.io/projected/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-kube-api-access-qwn7p\") pod \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " Sep 13 19:09:26.636866 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.636602 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-serving-cert\") pod \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " Sep 13 19:09:26.636866 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.636619 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-oauth-config\") pod \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\" (UID: \"e6e80c57-8f8e-4e6b-81a7-6612aa719b46\") " Sep 13 19:09:26.637021 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.636980 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6e80c57-8f8e-4e6b-81a7-6612aa719b46" (UID: "e6e80c57-8f8e-4e6b-81a7-6612aa719b46"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 19:09:26.637087 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.637062 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6e80c57-8f8e-4e6b-81a7-6612aa719b46" (UID: "e6e80c57-8f8e-4e6b-81a7-6612aa719b46"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 19:09:26.637132 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.637077 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-config" (OuterVolumeSpecName: "console-config") pod "e6e80c57-8f8e-4e6b-81a7-6612aa719b46" (UID: "e6e80c57-8f8e-4e6b-81a7-6612aa719b46"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 19:09:26.638955 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.638920 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6e80c57-8f8e-4e6b-81a7-6612aa719b46" (UID: "e6e80c57-8f8e-4e6b-81a7-6612aa719b46"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 19:09:26.639050 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.638960 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-kube-api-access-qwn7p" (OuterVolumeSpecName: "kube-api-access-qwn7p") pod "e6e80c57-8f8e-4e6b-81a7-6612aa719b46" (UID: "e6e80c57-8f8e-4e6b-81a7-6612aa719b46"). InnerVolumeSpecName "kube-api-access-qwn7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:09:26.639050 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.639022 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6e80c57-8f8e-4e6b-81a7-6612aa719b46" (UID: "e6e80c57-8f8e-4e6b-81a7-6612aa719b46"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 19:09:26.737304 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.737259 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwn7p\" (UniqueName: \"kubernetes.io/projected/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-kube-api-access-qwn7p\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:09:26.737304 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.737291 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-serving-cert\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:09:26.737304 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.737301 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-oauth-config\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:09:26.737304 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.737311 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-oauth-serving-cert\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:09:26.737559 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.737320 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-console-config\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:09:26.737559 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:26.737328 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e80c57-8f8e-4e6b-81a7-6612aa719b46-service-ca\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:09:27.215944 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.215909 2555 generic.go:356] "Generic (PLEG): container finished" podID="e6e80c57-8f8e-4e6b-81a7-6612aa719b46" containerID="f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2" exitCode=0 Sep 13 19:09:27.215944 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.215946 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7996bf64f8-5xfx6" event={"ID":"e6e80c57-8f8e-4e6b-81a7-6612aa719b46","Type":"ContainerDied","Data":"f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2"} Sep 13 19:09:27.216191 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.215957 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7996bf64f8-5xfx6" Sep 13 19:09:27.216191 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.215985 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7996bf64f8-5xfx6" event={"ID":"e6e80c57-8f8e-4e6b-81a7-6612aa719b46","Type":"ContainerDied","Data":"87f3a631de9c3599c8f88a416128ea926d6c98c1a3d64ca6a1cb48aa09d2d342"} Sep 13 19:09:27.216191 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.216006 2555 scope.go:117] "RemoveContainer" containerID="f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2" Sep 13 19:09:27.224760 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.224672 2555 scope.go:117] "RemoveContainer" containerID="f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2" Sep 13 19:09:27.225317 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:09:27.225226 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2\": container with ID starting with f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2 not found: ID does not exist" containerID="f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2" Sep 13 19:09:27.225317 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.225260 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2"} err="failed to get container status \"f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2\": rpc error: code = NotFound desc = could not find container \"f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2\": container with ID starting with f050471ca5fa98ceb1f7a99ca5e454aa62434f324cc7ec53c50e37cdc7cc1fb2 not found: ID does not exist" Sep 13 19:09:27.231492 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.231472 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7996bf64f8-5xfx6"] Sep 13 19:09:27.233217 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:27.233193 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7996bf64f8-5xfx6"] Sep 13 19:09:29.008630 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:29.008589 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6e80c57-8f8e-4e6b-81a7-6612aa719b46" path="/var/lib/kubelet/pods/e6e80c57-8f8e-4e6b-81a7-6612aa719b46/volumes" Sep 13 19:09:29.464982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:29.464892 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" podUID="62001f75-33c3-4734-bb77-fc5b17cde81b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 13 19:09:30.072460 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:30.072429 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:30.171016 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:30.170985 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:09:39.465134 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:39.465098 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" podUID="62001f75-33c3-4734-bb77-fc5b17cde81b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 13 19:09:49.465311 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:49.465272 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" podUID="62001f75-33c3-4734-bb77-fc5b17cde81b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 13 19:09:49.465732 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:49.465348 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" Sep 13 19:09:49.465822 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:49.465805 2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b82318d8cff3bab0f978e86fa0e0c638605cdb539368f37b9b046e28d8313e85"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 13 19:09:49.465862 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:49.465843 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" podUID="62001f75-33c3-4734-bb77-fc5b17cde81b" containerName="service-proxy" containerID="cri-o://b82318d8cff3bab0f978e86fa0e0c638605cdb539368f37b9b046e28d8313e85" gracePeriod=30 Sep 13 19:09:50.294670 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:50.294635 2555 generic.go:356] "Generic (PLEG): container finished" podID="62001f75-33c3-4734-bb77-fc5b17cde81b" containerID="b82318d8cff3bab0f978e86fa0e0c638605cdb539368f37b9b046e28d8313e85" exitCode=2 Sep 13 19:09:50.294850 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:50.294709 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" event={"ID":"62001f75-33c3-4734-bb77-fc5b17cde81b","Type":"ContainerDied","Data":"b82318d8cff3bab0f978e86fa0e0c638605cdb539368f37b9b046e28d8313e85"} Sep 13 19:09:50.294850 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:09:50.294755 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864d6d8f4b-l4hmh" event={"ID":"62001f75-33c3-4734-bb77-fc5b17cde81b","Type":"ContainerStarted","Data":"773748ea303f28e6955c9e99ff2d441ba383f753e626a1cb75dd465b80c06632"} Sep 13 19:10:00.554464 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:00.554426 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:00.654957 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:00.654926 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:04.028879 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:04.028830 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:04.225587 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:04.225533 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:04.925276 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:04.925232 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:10:04.927423 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:04.927404 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/597e5ef6-551e-4d79-abf3-59e08bb4565e-metrics-certs\") pod \"network-metrics-daemon-q7q4c\" (UID: \"597e5ef6-551e-4d79-abf3-59e08bb4565e\") " pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:10:05.107337 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:05.107306 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-454nd\"" Sep 13 19:10:05.114570 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:05.114545 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7q4c" Sep 13 19:10:05.388063 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:05.388034 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q7q4c"] Sep 13 19:10:05.391016 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:10:05.390986 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597e5ef6_551e_4d79_abf3_59e08bb4565e.slice/crio-a6ce7bd8a00902e032912510f68cb354aba467445cb174082890c27a718193f9 WatchSource:0}: Error finding container a6ce7bd8a00902e032912510f68cb354aba467445cb174082890c27a718193f9: Status 404 returned error can't find the container with id a6ce7bd8a00902e032912510f68cb354aba467445cb174082890c27a718193f9 Sep 13 19:10:05.392942 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:05.392927 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 19:10:06.345790 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:06.345758 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7q4c" event={"ID":"597e5ef6-551e-4d79-abf3-59e08bb4565e","Type":"ContainerStarted","Data":"a6ce7bd8a00902e032912510f68cb354aba467445cb174082890c27a718193f9"} Sep 13 19:10:07.351915 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:07.351880 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7q4c" event={"ID":"597e5ef6-551e-4d79-abf3-59e08bb4565e","Type":"ContainerStarted","Data":"f42ea06e0abe509c95a9988b2b566853bc2122910b56be33b22f70af48e92242"} Sep 13 19:10:07.352279 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:07.351931 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7q4c" event={"ID":"597e5ef6-551e-4d79-abf3-59e08bb4565e","Type":"ContainerStarted","Data":"9477347bcdc8e88bdfa71238e5cadd965948f53c53bb7b0210d362deecb9a719"} Sep 13 19:10:07.366579 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:07.366524 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q7q4c" podStartSLOduration=375.474776425 podStartE2EDuration="6m16.366504818s" totalImagesPullingTime="891.728393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:10:07.365954317 +0000 UTC m=+376.833515510" watchObservedRunningTime="2026-09-13 19:10:07.366504818 +0000 UTC m=+376.834066008" Sep 13 19:10:07.445622 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:07.445593 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:07.498885 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:07.498856 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:12.643472 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.643434 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6998b7cd-6lllp"] Sep 13 19:10:12.643873 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.643664 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6e80c57-8f8e-4e6b-81a7-6612aa719b46" containerName="console" Sep 13 19:10:12.643873 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.643676 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6e80c57-8f8e-4e6b-81a7-6612aa719b46" containerName="console" Sep 13 19:10:12.643873 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.643734 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e80c57-8f8e-4e6b-81a7-6612aa719b46" containerName="console" Sep 13 19:10:12.646511 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.646494 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.649200 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.649177 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 13 19:10:12.649321 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.649225 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 13 19:10:12.650447 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.650422 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 13 19:10:12.650693 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.650424 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hg8ww\"" Sep 13 19:10:12.650693 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.650428 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 13 19:10:12.650693 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.650482 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 13 19:10:12.650693 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.650522 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 13 19:10:12.651632 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.651579 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 13 19:10:12.655009 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.654991 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 13 19:10:12.658018 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.657999 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6998b7cd-6lllp"] Sep 13 19:10:12.690561 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.690536 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:12.739430 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.739410 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:12.779555 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.779529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-serving-cert\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.779653 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.779564 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-oauth-serving-cert\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.779653 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.779599 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg92g\" (UniqueName: \"kubernetes.io/projected/93324484-09b4-446e-a78a-8a366f528571-kube-api-access-bg92g\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.779771 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.779654 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-trusted-ca-bundle\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.779771 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.779707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-service-ca\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.779771 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.779730 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-console-config\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.779771 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.779756 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-oauth-config\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.880997 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.880968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-service-ca\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881102 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881003 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-console-config\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881102 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881026 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-oauth-config\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881102 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881074 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-serving-cert\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881250 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881117 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-oauth-serving-cert\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881250 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881155 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg92g\" (UniqueName: \"kubernetes.io/projected/93324484-09b4-446e-a78a-8a366f528571-kube-api-access-bg92g\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881435 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881407 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-trusted-ca-bundle\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881800 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881778 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-console-config\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881897 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881856 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-oauth-serving-cert\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.881897 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.881863 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-service-ca\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.882209 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.882188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-trusted-ca-bundle\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.883448 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.883428 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-oauth-config\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.883564 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.883548 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-serving-cert\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.889826 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.889806 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg92g\" (UniqueName: \"kubernetes.io/projected/93324484-09b4-446e-a78a-8a366f528571-kube-api-access-bg92g\") pod \"console-c6998b7cd-6lllp\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:12.955520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:12.955460 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:13.221753 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:13.221663 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6998b7cd-6lllp"] Sep 13 19:10:13.224570 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:10:13.224538 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93324484_09b4_446e_a78a_8a366f528571.slice/crio-03e2603f04d9bee0e8269e26f5f1b51820e615e2d0c8c32d389c7c2c7063fb46 WatchSource:0}: Error finding container 03e2603f04d9bee0e8269e26f5f1b51820e615e2d0c8c32d389c7c2c7063fb46: Status 404 returned error can't find the container with id 03e2603f04d9bee0e8269e26f5f1b51820e615e2d0c8c32d389c7c2c7063fb46 Sep 13 19:10:13.374847 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:13.374814 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6998b7cd-6lllp" event={"ID":"93324484-09b4-446e-a78a-8a366f528571","Type":"ContainerStarted","Data":"ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7"} Sep 13 19:10:13.374995 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:13.374866 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6998b7cd-6lllp" event={"ID":"93324484-09b4-446e-a78a-8a366f528571","Type":"ContainerStarted","Data":"03e2603f04d9bee0e8269e26f5f1b51820e615e2d0c8c32d389c7c2c7063fb46"} Sep 13 19:10:13.390860 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:13.390815 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6998b7cd-6lllp" podStartSLOduration=1.390799861 podStartE2EDuration="1.390799861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:10:13.390023803 +0000 UTC m=+382.857584991" watchObservedRunningTime="2026-09-13 19:10:13.390799861 +0000 UTC m=+382.858361049" Sep 13 19:10:22.956584 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:22.956548 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:22.957072 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:22.956648 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:22.961524 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:22.961503 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:23.411813 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:23.411787 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:10:23.561127 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:23.561082 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:23.610811 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:23.610777 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:10:23.663580 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:10:23.663526 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:02.057544 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:02.057510 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:02.108444 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:02.108408 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:19.219661 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:19.219578 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:19.319667 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:19.319635 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:28.062029 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:28.061988 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:28.107857 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:28.107824 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:31.066071 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:31.066037 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:31.116330 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:31.116301 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:38.938901 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:38.938866 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6998b7cd-6lllp"] Sep 13 19:11:39.024366 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:39.024331 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:39.073213 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:39.073187 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:39.129463 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:39.129441 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:39.179089 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:39.179057 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:45.083142 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:45.083106 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:11:45.183484 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:11:45.183444 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:12:03.770864 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:03.770827 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:12:03.957442 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:03.957397 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c6998b7cd-6lllp" podUID="93324484-09b4-446e-a78a-8a366f528571" containerName="console" containerID="cri-o://ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7" gracePeriod=15 Sep 13 19:12:04.191920 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.191895 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:12:04.318585 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.318476 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg92g\" (UniqueName: \"kubernetes.io/projected/93324484-09b4-446e-a78a-8a366f528571-kube-api-access-bg92g\") pod \"93324484-09b4-446e-a78a-8a366f528571\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " Sep 13 19:12:04.318585 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.318559 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-service-ca\") pod \"93324484-09b4-446e-a78a-8a366f528571\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " Sep 13 19:12:04.318585 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.318581 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-serving-cert\") pod \"93324484-09b4-446e-a78a-8a366f528571\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " Sep 13 19:12:04.318904 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.318733 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-oauth-config\") pod \"93324484-09b4-446e-a78a-8a366f528571\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " Sep 13 19:12:04.318904 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.318774 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-console-config\") pod \"93324484-09b4-446e-a78a-8a366f528571\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " Sep 13 19:12:04.318904 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.318799 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-trusted-ca-bundle\") pod \"93324484-09b4-446e-a78a-8a366f528571\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " Sep 13 19:12:04.318904 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.318816 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-oauth-serving-cert\") pod \"93324484-09b4-446e-a78a-8a366f528571\" (UID: \"93324484-09b4-446e-a78a-8a366f528571\") " Sep 13 19:12:04.319102 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.319029 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-service-ca" (OuterVolumeSpecName: "service-ca") pod "93324484-09b4-446e-a78a-8a366f528571" (UID: "93324484-09b4-446e-a78a-8a366f528571"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 19:12:04.319215 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.319142 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-console-config" (OuterVolumeSpecName: "console-config") pod "93324484-09b4-446e-a78a-8a366f528571" (UID: "93324484-09b4-446e-a78a-8a366f528571"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 19:12:04.319263 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.319218 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "93324484-09b4-446e-a78a-8a366f528571" (UID: "93324484-09b4-446e-a78a-8a366f528571"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 19:12:04.319263 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.319253 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "93324484-09b4-446e-a78a-8a366f528571" (UID: "93324484-09b4-446e-a78a-8a366f528571"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 19:12:04.320610 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.320591 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "93324484-09b4-446e-a78a-8a366f528571" (UID: "93324484-09b4-446e-a78a-8a366f528571"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 19:12:04.321021 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.320996 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93324484-09b4-446e-a78a-8a366f528571-kube-api-access-bg92g" (OuterVolumeSpecName: "kube-api-access-bg92g") pod "93324484-09b4-446e-a78a-8a366f528571" (UID: "93324484-09b4-446e-a78a-8a366f528571"). InnerVolumeSpecName "kube-api-access-bg92g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:12:04.321241 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.321217 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "93324484-09b4-446e-a78a-8a366f528571" (UID: "93324484-09b4-446e-a78a-8a366f528571"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 19:12:04.419479 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.419435 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-console-config\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:12:04.419479 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.419475 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-trusted-ca-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:12:04.419479 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.419486 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-oauth-serving-cert\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:12:04.419479 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.419495 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg92g\" (UniqueName: \"kubernetes.io/projected/93324484-09b4-446e-a78a-8a366f528571-kube-api-access-bg92g\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:12:04.419722 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.419504 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93324484-09b4-446e-a78a-8a366f528571-service-ca\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:12:04.419722 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.419512 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-serving-cert\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:12:04.419722 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.419520 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93324484-09b4-446e-a78a-8a366f528571-console-oauth-config\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:12:04.754142 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.754112 2555 generic.go:356] "Generic (PLEG): container finished" podID="93324484-09b4-446e-a78a-8a366f528571" containerID="ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7" exitCode=0 Sep 13 19:12:04.754306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.754150 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6998b7cd-6lllp" Sep 13 19:12:04.754306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.754206 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6998b7cd-6lllp" event={"ID":"93324484-09b4-446e-a78a-8a366f528571","Type":"ContainerDied","Data":"ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7"} Sep 13 19:12:04.754306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.754248 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6998b7cd-6lllp" event={"ID":"93324484-09b4-446e-a78a-8a366f528571","Type":"ContainerDied","Data":"03e2603f04d9bee0e8269e26f5f1b51820e615e2d0c8c32d389c7c2c7063fb46"} Sep 13 19:12:04.754306 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.754266 2555 scope.go:117] "RemoveContainer" containerID="ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7" Sep 13 19:12:04.762546 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.762527 2555 scope.go:117] "RemoveContainer" containerID="ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7" Sep 13 19:12:04.762841 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:12:04.762823 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7\": container with ID starting with ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7 not found: ID does not exist" containerID="ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7" Sep 13 19:12:04.762901 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.762849 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7"} err="failed to get container status \"ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7\": rpc error: code = NotFound desc = could not find container \"ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7\": container with ID starting with ec21101be15755c7a5ee8f6160972b1a3bce9766faad9a7271377b19626613d7 not found: ID does not exist" Sep 13 19:12:04.773846 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.773816 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6998b7cd-6lllp"] Sep 13 19:12:04.777323 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:04.777302 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6998b7cd-6lllp"] Sep 13 19:12:05.008457 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:05.008385 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93324484-09b4-446e-a78a-8a366f528571" path="/var/lib/kubelet/pods/93324484-09b4-446e-a78a-8a366f528571/volumes" Sep 13 19:12:21.689792 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:21.689760 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:12:41.123994 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:41.123951 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:12:41.172992 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:41.172964 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:12:42.326859 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:42.326832 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:12:42.373420 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:42.373390 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:12:43.034015 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.033986 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97"] Sep 13 19:12:43.034223 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.034211 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93324484-09b4-446e-a78a-8a366f528571" containerName="console" Sep 13 19:12:43.034279 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.034224 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="93324484-09b4-446e-a78a-8a366f528571" containerName="console" Sep 13 19:12:43.034279 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.034268 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="93324484-09b4-446e-a78a-8a366f528571" containerName="console" Sep 13 19:12:43.037023 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.037002 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.039369 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.039338 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 13 19:12:43.039369 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.039366 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 13 19:12:43.040441 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.040420 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d96bt\"" Sep 13 19:12:43.045283 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.045263 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97"] Sep 13 19:12:43.079517 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.079487 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftwnq\" (UniqueName: \"kubernetes.io/projected/07692064-e689-4d82-8a75-1f2b911cf31f-kube-api-access-ftwnq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.079631 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.079551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.079631 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.079577 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.180540 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.180511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.180631 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.180543 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.180631 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.180592 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwnq\" (UniqueName: \"kubernetes.io/projected/07692064-e689-4d82-8a75-1f2b911cf31f-kube-api-access-ftwnq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.180983 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.180962 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.180983 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.180971 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.188911 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.188891 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftwnq\" (UniqueName: \"kubernetes.io/projected/07692064-e689-4d82-8a75-1f2b911cf31f-kube-api-access-ftwnq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.346158 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.346085 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:12:43.611560 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.611537 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97"] Sep 13 19:12:43.614137 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:12:43.614107 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07692064_e689_4d82_8a75_1f2b911cf31f.slice/crio-c3fb10f1672c594a43dc9c4289f966f91ea648972f0c3c0fc60d2a6d906aeaa0 WatchSource:0}: Error finding container c3fb10f1672c594a43dc9c4289f966f91ea648972f0c3c0fc60d2a6d906aeaa0: Status 404 returned error can't find the container with id c3fb10f1672c594a43dc9c4289f966f91ea648972f0c3c0fc60d2a6d906aeaa0 Sep 13 19:12:43.885982 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:43.885904 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" event={"ID":"07692064-e689-4d82-8a75-1f2b911cf31f","Type":"ContainerStarted","Data":"c3fb10f1672c594a43dc9c4289f966f91ea648972f0c3c0fc60d2a6d906aeaa0"} Sep 13 19:12:50.914484 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:50.914446 2555 generic.go:356] "Generic (PLEG): container finished" podID="07692064-e689-4d82-8a75-1f2b911cf31f" containerID="491b697be053768d8206389b5a9bab26e83c4ca21020e8ea17fcdca0632ec701" exitCode=0 Sep 13 19:12:50.914919 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:50.914538 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" event={"ID":"07692064-e689-4d82-8a75-1f2b911cf31f","Type":"ContainerDied","Data":"491b697be053768d8206389b5a9bab26e83c4ca21020e8ea17fcdca0632ec701"} Sep 13 19:12:53.926941 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:53.926904 2555 generic.go:356] "Generic (PLEG): container finished" podID="07692064-e689-4d82-8a75-1f2b911cf31f" containerID="c2994c9ca8a4da5f03b55e36c602764b453f43681605d8a2ed4891182f09dcb8" exitCode=0 Sep 13 19:12:53.927423 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:12:53.926949 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" event={"ID":"07692064-e689-4d82-8a75-1f2b911cf31f","Type":"ContainerDied","Data":"c2994c9ca8a4da5f03b55e36c602764b453f43681605d8a2ed4891182f09dcb8"} Sep 13 19:13:01.958451 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:01.958363 2555 generic.go:356] "Generic (PLEG): container finished" podID="07692064-e689-4d82-8a75-1f2b911cf31f" containerID="493bb53b2e76103e5f989706950aa6dc2382036595832fc91037b610432aef1c" exitCode=0 Sep 13 19:13:01.958451 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:01.958437 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" event={"ID":"07692064-e689-4d82-8a75-1f2b911cf31f","Type":"ContainerDied","Data":"493bb53b2e76103e5f989706950aa6dc2382036595832fc91037b610432aef1c"} Sep 13 19:13:03.076883 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.076859 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:13:03.131441 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.131412 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-bundle\") pod \"07692064-e689-4d82-8a75-1f2b911cf31f\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " Sep 13 19:13:03.131568 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.131502 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftwnq\" (UniqueName: \"kubernetes.io/projected/07692064-e689-4d82-8a75-1f2b911cf31f-kube-api-access-ftwnq\") pod \"07692064-e689-4d82-8a75-1f2b911cf31f\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " Sep 13 19:13:03.131568 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.131531 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-util\") pod \"07692064-e689-4d82-8a75-1f2b911cf31f\" (UID: \"07692064-e689-4d82-8a75-1f2b911cf31f\") " Sep 13 19:13:03.132095 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.132070 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-bundle" (OuterVolumeSpecName: "bundle") pod "07692064-e689-4d82-8a75-1f2b911cf31f" (UID: "07692064-e689-4d82-8a75-1f2b911cf31f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:13:03.133549 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.133524 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07692064-e689-4d82-8a75-1f2b911cf31f-kube-api-access-ftwnq" (OuterVolumeSpecName: "kube-api-access-ftwnq") pod "07692064-e689-4d82-8a75-1f2b911cf31f" (UID: "07692064-e689-4d82-8a75-1f2b911cf31f"). InnerVolumeSpecName "kube-api-access-ftwnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:13:03.136144 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.136122 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-util" (OuterVolumeSpecName: "util") pod "07692064-e689-4d82-8a75-1f2b911cf31f" (UID: "07692064-e689-4d82-8a75-1f2b911cf31f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:13:03.232731 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.232631 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:03.232731 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.232667 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftwnq\" (UniqueName: \"kubernetes.io/projected/07692064-e689-4d82-8a75-1f2b911cf31f-kube-api-access-ftwnq\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:03.232731 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.232700 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07692064-e689-4d82-8a75-1f2b911cf31f-util\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:03.966700 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.966663 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" Sep 13 19:13:03.966869 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.966663 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpj97" event={"ID":"07692064-e689-4d82-8a75-1f2b911cf31f","Type":"ContainerDied","Data":"c3fb10f1672c594a43dc9c4289f966f91ea648972f0c3c0fc60d2a6d906aeaa0"} Sep 13 19:13:03.966869 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:03.966790 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3fb10f1672c594a43dc9c4289f966f91ea648972f0c3c0fc60d2a6d906aeaa0" Sep 13 19:13:09.036374 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:09.036320 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:09.790223 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:09.790189 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:12.643195 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:12.643134 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:12.713998 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:12.713967 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:14.595122 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:14.595094 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:14.701959 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:14.701931 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:14.807048 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:14.807020 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:14.939635 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:14.939558 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:15.343014 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.342967 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx"] Sep 13 19:13:15.343224 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.343213 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07692064-e689-4d82-8a75-1f2b911cf31f" containerName="extract" Sep 13 19:13:15.343267 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.343226 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="07692064-e689-4d82-8a75-1f2b911cf31f" containerName="extract" Sep 13 19:13:15.343267 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.343242 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07692064-e689-4d82-8a75-1f2b911cf31f" containerName="util" Sep 13 19:13:15.343325 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.343271 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="07692064-e689-4d82-8a75-1f2b911cf31f" containerName="util" Sep 13 19:13:15.343325 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.343277 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07692064-e689-4d82-8a75-1f2b911cf31f" containerName="pull" Sep 13 19:13:15.343325 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.343282 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="07692064-e689-4d82-8a75-1f2b911cf31f" containerName="pull" Sep 13 19:13:15.343412 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.343330 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="07692064-e689-4d82-8a75-1f2b911cf31f" containerName="extract" Sep 13 19:13:15.347232 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.347215 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.349645 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.349621 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 13 19:13:15.349772 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.349622 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d96bt\"" Sep 13 19:13:15.350598 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.350580 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 13 19:13:15.354133 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.353872 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx"] Sep 13 19:13:15.416085 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.416059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.416196 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.416096 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.416196 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.416115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bj76\" (UniqueName: \"kubernetes.io/projected/db0e0a83-97b6-4929-86ba-261429cfe64a-kube-api-access-2bj76\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.516457 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.516429 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.516574 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.516461 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.516574 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.516482 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bj76\" (UniqueName: \"kubernetes.io/projected/db0e0a83-97b6-4929-86ba-261429cfe64a-kube-api-access-2bj76\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.516913 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.516891 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.516913 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.516905 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.526821 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.526800 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bj76\" (UniqueName: \"kubernetes.io/projected/db0e0a83-97b6-4929-86ba-261429cfe64a-kube-api-access-2bj76\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.656848 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.656773 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:15.921524 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:15.921366 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx"] Sep 13 19:13:15.924217 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:13:15.924191 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0e0a83_97b6_4929_86ba_261429cfe64a.slice/crio-9d7deb581e4cd03b7542cedcbf6443de728614b1ada8f3b1f7dfccbc7d2bc340 WatchSource:0}: Error finding container 9d7deb581e4cd03b7542cedcbf6443de728614b1ada8f3b1f7dfccbc7d2bc340: Status 404 returned error can't find the container with id 9d7deb581e4cd03b7542cedcbf6443de728614b1ada8f3b1f7dfccbc7d2bc340 Sep 13 19:13:16.010821 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:16.010785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" event={"ID":"db0e0a83-97b6-4929-86ba-261429cfe64a","Type":"ContainerStarted","Data":"9b7fa7290de12aeeefcd15fe75d6a7848160522ff92392dc3608faec92ebed65"} Sep 13 19:13:16.010949 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:16.010857 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" event={"ID":"db0e0a83-97b6-4929-86ba-261429cfe64a","Type":"ContainerStarted","Data":"9d7deb581e4cd03b7542cedcbf6443de728614b1ada8f3b1f7dfccbc7d2bc340"} Sep 13 19:13:16.781497 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:16.781417 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:17.015824 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:17.015789 2555 generic.go:356] "Generic (PLEG): container finished" podID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerID="9b7fa7290de12aeeefcd15fe75d6a7848160522ff92392dc3608faec92ebed65" exitCode=0 Sep 13 19:13:17.015824 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:17.015824 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" event={"ID":"db0e0a83-97b6-4929-86ba-261429cfe64a","Type":"ContainerDied","Data":"9b7fa7290de12aeeefcd15fe75d6a7848160522ff92392dc3608faec92ebed65"} Sep 13 19:13:17.178477 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:17.178406 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:19.024877 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:19.024848 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" event={"ID":"db0e0a83-97b6-4929-86ba-261429cfe64a","Type":"ContainerStarted","Data":"50fbab33206d80ba88c59e67d9d3f7c6764d037b6b95b9bfcebb76c303816915"} Sep 13 19:13:19.440283 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:19.440252 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:19.494349 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:19.494320 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:20.030978 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:20.030945 2555 generic.go:356] "Generic (PLEG): container finished" podID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerID="50fbab33206d80ba88c59e67d9d3f7c6764d037b6b95b9bfcebb76c303816915" exitCode=0 Sep 13 19:13:20.031362 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:20.031001 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" event={"ID":"db0e0a83-97b6-4929-86ba-261429cfe64a","Type":"ContainerDied","Data":"50fbab33206d80ba88c59e67d9d3f7c6764d037b6b95b9bfcebb76c303816915"} Sep 13 19:13:21.036697 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:21.036653 2555 generic.go:356] "Generic (PLEG): container finished" podID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerID="26bc7f7f660a1418371749d9d54edd6e8db9c55d013017bf3e27f9f323acf673" exitCode=0 Sep 13 19:13:21.037082 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:21.036739 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" event={"ID":"db0e0a83-97b6-4929-86ba-261429cfe64a","Type":"ContainerDied","Data":"26bc7f7f660a1418371749d9d54edd6e8db9c55d013017bf3e27f9f323acf673"} Sep 13 19:13:22.160766 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.160740 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:22.265392 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.265362 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-bundle\") pod \"db0e0a83-97b6-4929-86ba-261429cfe64a\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " Sep 13 19:13:22.265392 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.265396 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-util\") pod \"db0e0a83-97b6-4929-86ba-261429cfe64a\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " Sep 13 19:13:22.265636 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.265423 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bj76\" (UniqueName: \"kubernetes.io/projected/db0e0a83-97b6-4929-86ba-261429cfe64a-kube-api-access-2bj76\") pod \"db0e0a83-97b6-4929-86ba-261429cfe64a\" (UID: \"db0e0a83-97b6-4929-86ba-261429cfe64a\") " Sep 13 19:13:22.265845 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.265812 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-bundle" (OuterVolumeSpecName: "bundle") pod "db0e0a83-97b6-4929-86ba-261429cfe64a" (UID: "db0e0a83-97b6-4929-86ba-261429cfe64a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:13:22.267701 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.267665 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db0e0a83-97b6-4929-86ba-261429cfe64a-kube-api-access-2bj76" (OuterVolumeSpecName: "kube-api-access-2bj76") pod "db0e0a83-97b6-4929-86ba-261429cfe64a" (UID: "db0e0a83-97b6-4929-86ba-261429cfe64a"). InnerVolumeSpecName "kube-api-access-2bj76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:13:22.270491 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.270464 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-util" (OuterVolumeSpecName: "util") pod "db0e0a83-97b6-4929-86ba-261429cfe64a" (UID: "db0e0a83-97b6-4929-86ba-261429cfe64a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:13:22.366214 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.366137 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:22.366214 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.366163 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0e0a83-97b6-4929-86ba-261429cfe64a-util\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:22.366214 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:22.366173 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bj76\" (UniqueName: \"kubernetes.io/projected/db0e0a83-97b6-4929-86ba-261429cfe64a-kube-api-access-2bj76\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:23.045921 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:23.045888 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" event={"ID":"db0e0a83-97b6-4929-86ba-261429cfe64a","Type":"ContainerDied","Data":"9d7deb581e4cd03b7542cedcbf6443de728614b1ada8f3b1f7dfccbc7d2bc340"} Sep 13 19:13:23.045921 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:23.045919 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gswx" Sep 13 19:13:23.046123 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:23.045940 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d7deb581e4cd03b7542cedcbf6443de728614b1ada8f3b1f7dfccbc7d2bc340" Sep 13 19:13:25.182635 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:25.182602 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:27.102181 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:27.102151 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:27.203532 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:27.203501 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:28.859920 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.859886 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq"] Sep 13 19:13:28.860290 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.860095 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerName="util" Sep 13 19:13:28.860290 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.860105 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerName="util" Sep 13 19:13:28.860290 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.860113 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerName="pull" Sep 13 19:13:28.860290 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.860118 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerName="pull" Sep 13 19:13:28.860290 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.860134 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerName="extract" Sep 13 19:13:28.860290 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.860140 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerName="extract" Sep 13 19:13:28.860290 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.860177 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="db0e0a83-97b6-4929-86ba-261429cfe64a" containerName="extract" Sep 13 19:13:28.892997 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.892958 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq"] Sep 13 19:13:28.893124 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.893039 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" Sep 13 19:13:28.895697 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.895658 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 13 19:13:28.895823 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.895658 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 13 19:13:28.896711 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:28.896691 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-n727f\"" Sep 13 19:13:29.011090 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:29.011063 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9sxv\" (UniqueName: \"kubernetes.io/projected/5d33791c-e1ad-4d3e-b279-806bf944d46a-kube-api-access-j9sxv\") pod \"openshift-lws-operator-fd8ccff4c-ftxxq\" (UID: \"5d33791c-e1ad-4d3e-b279-806bf944d46a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" Sep 13 19:13:29.011210 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:29.011095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d33791c-e1ad-4d3e-b279-806bf944d46a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ftxxq\" (UID: \"5d33791c-e1ad-4d3e-b279-806bf944d46a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" Sep 13 19:13:29.112355 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:29.112288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9sxv\" (UniqueName: \"kubernetes.io/projected/5d33791c-e1ad-4d3e-b279-806bf944d46a-kube-api-access-j9sxv\") pod \"openshift-lws-operator-fd8ccff4c-ftxxq\" (UID: \"5d33791c-e1ad-4d3e-b279-806bf944d46a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" Sep 13 19:13:29.112355 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:29.112328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d33791c-e1ad-4d3e-b279-806bf944d46a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ftxxq\" (UID: \"5d33791c-e1ad-4d3e-b279-806bf944d46a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" Sep 13 19:13:29.112716 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:29.112672 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d33791c-e1ad-4d3e-b279-806bf944d46a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ftxxq\" (UID: \"5d33791c-e1ad-4d3e-b279-806bf944d46a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" Sep 13 19:13:29.120387 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:29.120368 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9sxv\" (UniqueName: \"kubernetes.io/projected/5d33791c-e1ad-4d3e-b279-806bf944d46a-kube-api-access-j9sxv\") pod \"openshift-lws-operator-fd8ccff4c-ftxxq\" (UID: \"5d33791c-e1ad-4d3e-b279-806bf944d46a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" Sep 13 19:13:29.201907 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:29.201885 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" Sep 13 19:13:29.490337 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:29.490249 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq"] Sep 13 19:13:29.494192 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:13:29.494165 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d33791c_e1ad_4d3e_b279_806bf944d46a.slice/crio-f276f792c11003c4e2aa7683dd254054c31a19e4da4313a2e05972af3947efb6 WatchSource:0}: Error finding container f276f792c11003c4e2aa7683dd254054c31a19e4da4313a2e05972af3947efb6: Status 404 returned error can't find the container with id f276f792c11003c4e2aa7683dd254054c31a19e4da4313a2e05972af3947efb6 Sep 13 19:13:30.070055 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:30.070021 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" event={"ID":"5d33791c-e1ad-4d3e-b279-806bf944d46a","Type":"ContainerStarted","Data":"f276f792c11003c4e2aa7683dd254054c31a19e4da4313a2e05972af3947efb6"} Sep 13 19:13:32.079376 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:32.079323 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" event={"ID":"5d33791c-e1ad-4d3e-b279-806bf944d46a","Type":"ContainerStarted","Data":"1bc81ddad51f5f3dc3b1e91638dd53ee4c18f43310c09397ad26270e75103aad"} Sep 13 19:13:32.095793 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:32.095750 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ftxxq" podStartSLOduration=1.921195451 podStartE2EDuration="4.095735369s" totalImagesPullingTime="2.174539918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:13:32.094458829 +0000 UTC m=+581.562020012" watchObservedRunningTime="2026-09-13 19:13:32.095735369 +0000 UTC m=+581.563296557" Sep 13 19:13:32.786065 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:32.786036 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:32.886488 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:32.886458 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:34.676130 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.676090 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr"] Sep 13 19:13:34.679475 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.679451 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.681780 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.681747 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d96bt\"" Sep 13 19:13:34.682762 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.682744 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 13 19:13:34.682887 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.682778 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 13 19:13:34.690892 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.690872 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr"] Sep 13 19:13:34.753389 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.753354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.753530 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.753441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b98p\" (UniqueName: \"kubernetes.io/projected/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-kube-api-access-9b98p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.753530 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.753513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.790188 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.790160 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:34.854697 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.854651 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.854796 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.854710 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.854796 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.854750 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b98p\" (UniqueName: \"kubernetes.io/projected/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-kube-api-access-9b98p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.855036 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.855019 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.855076 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.855032 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.862220 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.862197 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b98p\" (UniqueName: \"kubernetes.io/projected/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-kube-api-access-9b98p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:34.988511 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:34.988447 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:35.254166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:35.254143 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr"] Sep 13 19:13:35.256336 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:13:35.256309 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9c1f68_26d2_46ee_8fa6_c0ccf24ffcd9.slice/crio-97ab445e2d36148019a7796c9850926cddd2fb13ad4403610984ae623b439de2 WatchSource:0}: Error finding container 97ab445e2d36148019a7796c9850926cddd2fb13ad4403610984ae623b439de2: Status 404 returned error can't find the container with id 97ab445e2d36148019a7796c9850926cddd2fb13ad4403610984ae623b439de2 Sep 13 19:13:36.094770 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:36.094735 2555 generic.go:356] "Generic (PLEG): container finished" podID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerID="6386cb9bb0bd3b1aeef95320b44a7ee1db00a3dd0155c774bce82d397063681a" exitCode=0 Sep 13 19:13:36.095094 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:36.094819 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" event={"ID":"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9","Type":"ContainerDied","Data":"6386cb9bb0bd3b1aeef95320b44a7ee1db00a3dd0155c774bce82d397063681a"} Sep 13 19:13:36.095094 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:36.094895 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" event={"ID":"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9","Type":"ContainerStarted","Data":"97ab445e2d36148019a7796c9850926cddd2fb13ad4403610984ae623b439de2"} Sep 13 19:13:37.100573 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:37.100537 2555 generic.go:356] "Generic (PLEG): container finished" podID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerID="bc0314e7e866e0d57c3041a9c96d443614d509e115221bc6bab02c3b9dcfc5c6" exitCode=0 Sep 13 19:13:37.100942 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:37.100606 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" event={"ID":"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9","Type":"ContainerDied","Data":"bc0314e7e866e0d57c3041a9c96d443614d509e115221bc6bab02c3b9dcfc5c6"} Sep 13 19:13:38.106509 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:38.106480 2555 generic.go:356] "Generic (PLEG): container finished" podID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerID="b967febd17745c62c3bb54f0eb572efe389ece5ebae9036fa1931413dc44b664" exitCode=0 Sep 13 19:13:38.106869 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:38.106538 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" event={"ID":"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9","Type":"ContainerDied","Data":"b967febd17745c62c3bb54f0eb572efe389ece5ebae9036fa1931413dc44b664"} Sep 13 19:13:39.223916 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.223894 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:39.393858 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.393789 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b98p\" (UniqueName: \"kubernetes.io/projected/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-kube-api-access-9b98p\") pod \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " Sep 13 19:13:39.393858 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.393854 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-bundle\") pod \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " Sep 13 19:13:39.394020 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.393876 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-util\") pod \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\" (UID: \"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9\") " Sep 13 19:13:39.394511 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.394484 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-bundle" (OuterVolumeSpecName: "bundle") pod "6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" (UID: "6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:13:39.395807 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.395783 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-kube-api-access-9b98p" (OuterVolumeSpecName: "kube-api-access-9b98p") pod "6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" (UID: "6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9"). InnerVolumeSpecName "kube-api-access-9b98p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:13:39.399535 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.399515 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-util" (OuterVolumeSpecName: "util") pod "6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" (UID: "6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:13:39.494452 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.494413 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:39.494452 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.494447 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-util\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:39.494452 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:39.494457 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b98p\" (UniqueName: \"kubernetes.io/projected/6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9-kube-api-access-9b98p\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:40.115242 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:40.115211 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" Sep 13 19:13:40.115407 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:40.115213 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcd5dr" event={"ID":"6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9","Type":"ContainerDied","Data":"97ab445e2d36148019a7796c9850926cddd2fb13ad4403610984ae623b439de2"} Sep 13 19:13:40.115407 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:40.115330 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97ab445e2d36148019a7796c9850926cddd2fb13ad4403610984ae623b439de2" Sep 13 19:13:41.031668 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.031625 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbd7c8495-x562f"] Sep 13 19:13:41.032066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.031877 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerName="pull" Sep 13 19:13:41.032066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.031891 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerName="pull" Sep 13 19:13:41.032066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.031907 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerName="extract" Sep 13 19:13:41.032066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.031912 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerName="extract" Sep 13 19:13:41.032066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.031925 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerName="util" Sep 13 19:13:41.032066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.031931 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerName="util" Sep 13 19:13:41.032066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.031970 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9c1f68-26d2-46ee-8fa6-c0ccf24ffcd9" containerName="extract" Sep 13 19:13:41.033572 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.033554 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.036976 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.036953 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 13 19:13:41.038387 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.038369 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 13 19:13:41.038492 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.038480 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 13 19:13:41.038550 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.038501 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 13 19:13:41.038636 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.038613 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 13 19:13:41.039284 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.039260 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 13 19:13:41.039849 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.039829 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 13 19:13:41.039849 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.039841 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hg8ww\"" Sep 13 19:13:41.042799 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.042783 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 13 19:13:41.045865 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.045845 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbd7c8495-x562f"] Sep 13 19:13:41.081437 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.081407 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:41.184327 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.184298 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:41.203859 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.203835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-oauth-config\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.203963 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.203862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hb28\" (UniqueName: \"kubernetes.io/projected/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-kube-api-access-6hb28\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.203963 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.203879 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-oauth-serving-cert\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.203963 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.203903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-serving-cert\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.203963 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.203919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-service-ca\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.204089 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.203962 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-config\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.204089 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.203986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-trusted-ca-bundle\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.236359 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.236332 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:41.304514 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.304456 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-oauth-config\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.304514 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.304482 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hb28\" (UniqueName: \"kubernetes.io/projected/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-kube-api-access-6hb28\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.304514 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.304501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-oauth-serving-cert\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.304730 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.304526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-serving-cert\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.304730 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.304654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-service-ca\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.304730 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.304715 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-config\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.304880 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.304757 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-trusted-ca-bundle\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.305308 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.305275 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-oauth-serving-cert\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.305397 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.305385 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-service-ca\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.305473 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.305450 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-config\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.305778 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.305759 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-trusted-ca-bundle\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.306947 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.306929 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-oauth-config\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.307106 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.307088 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-console-serving-cert\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.312137 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.312115 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hb28\" (UniqueName: \"kubernetes.io/projected/c4bd4071-8bcc-435b-a296-7bfc5ba9597a-kube-api-access-6hb28\") pod \"console-5cbd7c8495-x562f\" (UID: \"c4bd4071-8bcc-435b-a296-7bfc5ba9597a\") " pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.343643 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.343606 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:41.610366 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:41.610341 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbd7c8495-x562f"] Sep 13 19:13:41.612774 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:13:41.612743 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4bd4071_8bcc_435b_a296_7bfc5ba9597a.slice/crio-e1b32eba5bc9423b202e848f624ad508d02c37b1cdf83012d232f82524a87a46 WatchSource:0}: Error finding container e1b32eba5bc9423b202e848f624ad508d02c37b1cdf83012d232f82524a87a46: Status 404 returned error can't find the container with id e1b32eba5bc9423b202e848f624ad508d02c37b1cdf83012d232f82524a87a46 Sep 13 19:13:42.124290 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:42.124252 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd7c8495-x562f" event={"ID":"c4bd4071-8bcc-435b-a296-7bfc5ba9597a","Type":"ContainerStarted","Data":"f4eeb4bccd44555d9acd9d7d70d542ecfab375f75a8e15fadb96c7f481cd0d73"} Sep 13 19:13:42.124731 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:42.124301 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd7c8495-x562f" event={"ID":"c4bd4071-8bcc-435b-a296-7bfc5ba9597a","Type":"ContainerStarted","Data":"e1b32eba5bc9423b202e848f624ad508d02c37b1cdf83012d232f82524a87a46"} Sep 13 19:13:42.143668 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:42.143613 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbd7c8495-x562f" podStartSLOduration=1.143597952 podStartE2EDuration="1.143597952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:13:42.142857616 +0000 UTC m=+591.610418806" watchObservedRunningTime="2026-09-13 19:13:42.143597952 +0000 UTC m=+591.611159140" Sep 13 19:13:46.929005 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:46.928962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:46.984044 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:46.984007 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52"] Sep 13 19:13:46.987077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:46.987055 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:46.990971 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:46.990946 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 13 19:13:46.991097 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:46.990946 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xl665\"" Sep 13 19:13:46.991256 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:46.991236 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 13 19:13:46.991365 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:46.991274 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 13 19:13:47.008327 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.008304 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52"] Sep 13 19:13:47.016113 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.016092 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:47.144556 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.144528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d36a55b7-2244-4012-8f1a-ca80cc6021d7-manager-config\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.144716 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.144564 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj8fg\" (UniqueName: \"kubernetes.io/projected/d36a55b7-2244-4012-8f1a-ca80cc6021d7-kube-api-access-vj8fg\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.144716 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.144592 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d36a55b7-2244-4012-8f1a-ca80cc6021d7-metrics-cert\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.144716 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.144695 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d36a55b7-2244-4012-8f1a-ca80cc6021d7-cert\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.245502 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.245481 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d36a55b7-2244-4012-8f1a-ca80cc6021d7-metrics-cert\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.245617 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.245519 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d36a55b7-2244-4012-8f1a-ca80cc6021d7-cert\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.245617 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.245589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d36a55b7-2244-4012-8f1a-ca80cc6021d7-manager-config\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.245705 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.245627 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj8fg\" (UniqueName: \"kubernetes.io/projected/d36a55b7-2244-4012-8f1a-ca80cc6021d7-kube-api-access-vj8fg\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.246240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.246219 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d36a55b7-2244-4012-8f1a-ca80cc6021d7-manager-config\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.248024 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.247996 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d36a55b7-2244-4012-8f1a-ca80cc6021d7-cert\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.248105 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.248004 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d36a55b7-2244-4012-8f1a-ca80cc6021d7-metrics-cert\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.254733 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.254712 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj8fg\" (UniqueName: \"kubernetes.io/projected/d36a55b7-2244-4012-8f1a-ca80cc6021d7-kube-api-access-vj8fg\") pod \"lws-controller-manager-5d96d9f8f5-jcn52\" (UID: \"d36a55b7-2244-4012-8f1a-ca80cc6021d7\") " pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.296698 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.296658 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:47.580125 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:47.580030 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52"] Sep 13 19:13:47.582657 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:13:47.582631 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36a55b7_2244_4012_8f1a_ca80cc6021d7.slice/crio-6757cec4b148a92c00ed2910b044cacc34fca9051523a9da08333be51f392eb2 WatchSource:0}: Error finding container 6757cec4b148a92c00ed2910b044cacc34fca9051523a9da08333be51f392eb2: Status 404 returned error can't find the container with id 6757cec4b148a92c00ed2910b044cacc34fca9051523a9da08333be51f392eb2 Sep 13 19:13:48.145450 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:48.145411 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" event={"ID":"d36a55b7-2244-4012-8f1a-ca80cc6021d7","Type":"ContainerStarted","Data":"6757cec4b148a92c00ed2910b044cacc34fca9051523a9da08333be51f392eb2"} Sep 13 19:13:50.154144 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:50.154105 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" event={"ID":"d36a55b7-2244-4012-8f1a-ca80cc6021d7","Type":"ContainerStarted","Data":"4c02f2b108b233057e94bc028e1e3e28bb4ec9f67bd4db1c335c9a1dba2ee644"} Sep 13 19:13:50.154506 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:50.154220 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:13:50.169962 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:50.169919 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" podStartSLOduration=2.580570594 podStartE2EDuration="4.169907188s" totalImagesPullingTime="1.589336594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:13:50.169353283 +0000 UTC m=+599.636914471" watchObservedRunningTime="2026-09-13 19:13:50.169907188 +0000 UTC m=+599.637468376" Sep 13 19:13:50.477661 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:50.477591 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:51.344207 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.344174 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:51.346634 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.344471 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:51.349166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.349146 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:51.431487 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.431457 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf"] Sep 13 19:13:51.439159 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.439135 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.442119 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.442100 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 13 19:13:51.442222 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.442158 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z5lr9\"" Sep 13 19:13:51.442222 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.442199 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 13 19:13:51.442848 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.442831 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 13 19:13:51.442926 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.442884 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 13 19:13:51.507103 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.507076 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf"] Sep 13 19:13:51.554400 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.554375 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx"] Sep 13 19:13:51.557428 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.557413 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.559836 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.559819 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 13 19:13:51.559922 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.559840 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d96bt\"" Sep 13 19:13:51.559987 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.559954 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 13 19:13:51.565387 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.565360 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx"] Sep 13 19:13:51.583929 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.583906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c59xm\" (UniqueName: \"kubernetes.io/projected/8604fd58-d485-4506-b720-a6c2501d0cd1-kube-api-access-c59xm\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.584021 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.583946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8604fd58-d485-4506-b720-a6c2501d0cd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.584021 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.583970 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8604fd58-d485-4506-b720-a6c2501d0cd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.584021 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.583986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8604fd58-d485-4506-b720-a6c2501d0cd1-manifests\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.584129 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.584041 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8604fd58-d485-4506-b720-a6c2501d0cd1-tmp\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.598102 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.598053 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:51.665918 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.665901 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:51.684811 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.684792 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.684898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.684836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8604fd58-d485-4506-b720-a6c2501d0cd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.684898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.684857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.684898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.684881 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbx7z\" (UniqueName: \"kubernetes.io/projected/bb29e071-eae2-4092-8a48-ea8ec568bb2c-kube-api-access-wbx7z\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.685012 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.684905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8604fd58-d485-4506-b720-a6c2501d0cd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.685012 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.684922 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8604fd58-d485-4506-b720-a6c2501d0cd1-manifests\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.685012 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.684951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8604fd58-d485-4506-b720-a6c2501d0cd1-tmp\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.685012 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.684994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c59xm\" (UniqueName: \"kubernetes.io/projected/8604fd58-d485-4506-b720-a6c2501d0cd1-kube-api-access-c59xm\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.685347 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.685325 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8604fd58-d485-4506-b720-a6c2501d0cd1-manifests\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.687231 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.687201 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8604fd58-d485-4506-b720-a6c2501d0cd1-tmp\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.687324 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.687306 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8604fd58-d485-4506-b720-a6c2501d0cd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.687367 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.687327 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8604fd58-d485-4506-b720-a6c2501d0cd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.692520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.692500 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c59xm\" (UniqueName: \"kubernetes.io/projected/8604fd58-d485-4506-b720-a6c2501d0cd1-kube-api-access-c59xm\") pod \"opendatahub-operator-controller-manager-65d87bcbcb-v4hxf\" (UID: \"8604fd58-d485-4506-b720-a6c2501d0cd1\") " pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.748520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.748494 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:51.765034 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.765013 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:51.786085 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.786051 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.786240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.786113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.786240 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.786141 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbx7z\" (UniqueName: \"kubernetes.io/projected/bb29e071-eae2-4092-8a48-ea8ec568bb2c-kube-api-access-wbx7z\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.786539 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.786517 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.786663 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.786642 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.797823 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.797794 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbx7z\" (UniqueName: \"kubernetes.io/projected/bb29e071-eae2-4092-8a48-ea8ec568bb2c-kube-api-access-wbx7z\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.865510 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.865450 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:51.866406 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.866378 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:51.965977 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:51.965947 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:52.032129 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.032099 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf"] Sep 13 19:13:52.035288 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:13:52.035257 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8604fd58_d485_4506_b720_a6c2501d0cd1.slice/crio-98698a6e348dc5672bf7cd7965586f7554ba597c17f59af49a897ab4594713a9 WatchSource:0}: Error finding container 98698a6e348dc5672bf7cd7965586f7554ba597c17f59af49a897ab4594713a9: Status 404 returned error can't find the container with id 98698a6e348dc5672bf7cd7965586f7554ba597c17f59af49a897ab4594713a9 Sep 13 19:13:52.035707 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.035661 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:52.138855 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.138802 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx"] Sep 13 19:13:52.140729 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:13:52.140702 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb29e071_eae2_4092_8a48_ea8ec568bb2c.slice/crio-bf37b874f38d41d06af8f05631ec9fcf47fbad334e023c4a780985f43086284b WatchSource:0}: Error finding container bf37b874f38d41d06af8f05631ec9fcf47fbad334e023c4a780985f43086284b: Status 404 returned error can't find the container with id bf37b874f38d41d06af8f05631ec9fcf47fbad334e023c4a780985f43086284b Sep 13 19:13:52.162282 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.162254 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" event={"ID":"8604fd58-d485-4506-b720-a6c2501d0cd1","Type":"ContainerStarted","Data":"98698a6e348dc5672bf7cd7965586f7554ba597c17f59af49a897ab4594713a9"} Sep 13 19:13:52.163423 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.163400 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" event={"ID":"bb29e071-eae2-4092-8a48-ea8ec568bb2c","Type":"ContainerStarted","Data":"bf37b874f38d41d06af8f05631ec9fcf47fbad334e023c4a780985f43086284b"} Sep 13 19:13:52.167318 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.167302 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbd7c8495-x562f" Sep 13 19:13:52.362862 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.362831 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:52.465183 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.465105 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:52.570774 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:52.570745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:13:53.172851 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:53.172787 2555 generic.go:356] "Generic (PLEG): container finished" podID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerID="d9f8c495d886a06b698f94f397de1c78859a2d48e5be1e4ab05233f59ef7ba31" exitCode=0 Sep 13 19:13:53.173032 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:53.172890 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" event={"ID":"bb29e071-eae2-4092-8a48-ea8ec568bb2c","Type":"ContainerDied","Data":"d9f8c495d886a06b698f94f397de1c78859a2d48e5be1e4ab05233f59ef7ba31"} Sep 13 19:13:55.184719 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:55.184665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" event={"ID":"8604fd58-d485-4506-b720-a6c2501d0cd1","Type":"ContainerStarted","Data":"d1281af7acda43db6d92268ddd54d50b2f5d05d3fffb6b29871d407dc4c76bc5"} Sep 13 19:13:56.190478 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:56.190443 2555 generic.go:356] "Generic (PLEG): container finished" podID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerID="017b3b1ec313e3f12fe1cf3a80ed9aae9e3aba5fd7165e1fe62afd67564bbc90" exitCode=0 Sep 13 19:13:56.190979 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:56.190509 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" event={"ID":"bb29e071-eae2-4092-8a48-ea8ec568bb2c","Type":"ContainerDied","Data":"017b3b1ec313e3f12fe1cf3a80ed9aae9e3aba5fd7165e1fe62afd67564bbc90"} Sep 13 19:13:56.192333 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:56.192308 2555 generic.go:356] "Generic (PLEG): container finished" podID="8604fd58-d485-4506-b720-a6c2501d0cd1" containerID="d1281af7acda43db6d92268ddd54d50b2f5d05d3fffb6b29871d407dc4c76bc5" exitCode=0 Sep 13 19:13:56.192436 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:56.192371 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" event={"ID":"8604fd58-d485-4506-b720-a6c2501d0cd1","Type":"ContainerDied","Data":"d1281af7acda43db6d92268ddd54d50b2f5d05d3fffb6b29871d407dc4c76bc5"} Sep 13 19:13:57.199380 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:57.199342 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" event={"ID":"8604fd58-d485-4506-b720-a6c2501d0cd1","Type":"ContainerStarted","Data":"23345b302f5b24b2bbf614b8ea1e8581c32f85ae932757456a45a6620e9519a5"} Sep 13 19:13:57.199851 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:57.199491 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:13:57.201600 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:57.201578 2555 generic.go:356] "Generic (PLEG): container finished" podID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerID="eaa11b921fb082aa184248737391a5696b8753d30741b63eeb9d7270dc90eb73" exitCode=0 Sep 13 19:13:57.201733 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:57.201624 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" event={"ID":"bb29e071-eae2-4092-8a48-ea8ec568bb2c","Type":"ContainerDied","Data":"eaa11b921fb082aa184248737391a5696b8753d30741b63eeb9d7270dc90eb73"} Sep 13 19:13:57.225200 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:57.222632 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" podStartSLOduration=1.819204743 podStartE2EDuration="6.222613285s" totalImagesPullingTime="3.398961107s" totalInitContainerRuntime="1.004447435s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:13:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:13:57.219305248 +0000 UTC m=+606.686866432" watchObservedRunningTime="2026-09-13 19:13:57.222613285 +0000 UTC m=+606.690174475" Sep 13 19:13:58.329042 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.329019 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:58.339389 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.339364 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-util\") pod \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " Sep 13 19:13:58.339503 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.339400 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-bundle\") pod \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " Sep 13 19:13:58.339503 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.339442 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbx7z\" (UniqueName: \"kubernetes.io/projected/bb29e071-eae2-4092-8a48-ea8ec568bb2c-kube-api-access-wbx7z\") pod \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\" (UID: \"bb29e071-eae2-4092-8a48-ea8ec568bb2c\") " Sep 13 19:13:58.340110 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.340087 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-bundle" (OuterVolumeSpecName: "bundle") pod "bb29e071-eae2-4092-8a48-ea8ec568bb2c" (UID: "bb29e071-eae2-4092-8a48-ea8ec568bb2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:13:58.341433 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.341410 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb29e071-eae2-4092-8a48-ea8ec568bb2c-kube-api-access-wbx7z" (OuterVolumeSpecName: "kube-api-access-wbx7z") pod "bb29e071-eae2-4092-8a48-ea8ec568bb2c" (UID: "bb29e071-eae2-4092-8a48-ea8ec568bb2c"). InnerVolumeSpecName "kube-api-access-wbx7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:13:58.344316 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.344268 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-util" (OuterVolumeSpecName: "util") pod "bb29e071-eae2-4092-8a48-ea8ec568bb2c" (UID: "bb29e071-eae2-4092-8a48-ea8ec568bb2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:13:58.440812 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.440782 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-util\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:58.440812 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.440809 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb29e071-eae2-4092-8a48-ea8ec568bb2c-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:58.440959 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:58.440818 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbx7z\" (UniqueName: \"kubernetes.io/projected/bb29e071-eae2-4092-8a48-ea8ec568bb2c-kube-api-access-wbx7z\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:13:59.212455 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:59.212426 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" Sep 13 19:13:59.212455 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:59.212438 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fx7xx" event={"ID":"bb29e071-eae2-4092-8a48-ea8ec568bb2c","Type":"ContainerDied","Data":"bf37b874f38d41d06af8f05631ec9fcf47fbad334e023c4a780985f43086284b"} Sep 13 19:13:59.212645 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:13:59.212478 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf37b874f38d41d06af8f05631ec9fcf47fbad334e023c4a780985f43086284b" Sep 13 19:14:01.159179 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:01.159146 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d96d9f8f5-jcn52" Sep 13 19:14:08.207868 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:08.207824 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65d87bcbcb-v4hxf" Sep 13 19:14:10.071527 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:10.071491 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:10.171208 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:10.171175 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:15.585892 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:15.585823 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:15.696644 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:15.696594 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:16.626070 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:16.626039 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:16.680251 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:16.680216 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:17.439547 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:17.439512 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:21.144968 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.144924 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:21.209109 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.209075 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:21.306827 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.306790 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:21.550510 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.550480 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:21.557259 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.557234 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wb9rl"] Sep 13 19:14:21.557487 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.557470 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerName="util" Sep 13 19:14:21.557487 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.557485 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerName="util" Sep 13 19:14:21.557659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.557509 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerName="pull" Sep 13 19:14:21.557659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.557516 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerName="pull" Sep 13 19:14:21.557659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.557526 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerName="extract" Sep 13 19:14:21.557659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.557535 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerName="extract" Sep 13 19:14:21.557659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.557608 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb29e071-eae2-4092-8a48-ea8ec568bb2c" containerName="extract" Sep 13 19:14:21.561534 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.561516 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:21.563953 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.563931 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 13 19:14:21.564056 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.564028 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rrrmt\"" Sep 13 19:14:21.570790 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.570768 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wb9rl"] Sep 13 19:14:21.605365 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.605332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b5ce730-3540-41e8-a91a-55443cb9635e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wb9rl\" (UID: \"6b5ce730-3540-41e8-a91a-55443cb9635e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:21.605521 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.605383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjsf\" (UniqueName: \"kubernetes.io/projected/6b5ce730-3540-41e8-a91a-55443cb9635e-kube-api-access-ltjsf\") pod \"model-serving-api-54d89bd5fc-wb9rl\" (UID: \"6b5ce730-3540-41e8-a91a-55443cb9635e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:21.705958 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.705929 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjsf\" (UniqueName: \"kubernetes.io/projected/6b5ce730-3540-41e8-a91a-55443cb9635e-kube-api-access-ltjsf\") pod \"model-serving-api-54d89bd5fc-wb9rl\" (UID: \"6b5ce730-3540-41e8-a91a-55443cb9635e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:21.706135 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.706010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b5ce730-3540-41e8-a91a-55443cb9635e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wb9rl\" (UID: \"6b5ce730-3540-41e8-a91a-55443cb9635e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:21.706218 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:14:21.706136 2555 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 13 19:14:21.706218 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:14:21.706214 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5ce730-3540-41e8-a91a-55443cb9635e-tls-certs podName:6b5ce730-3540-41e8-a91a-55443cb9635e nodeName:}" failed. No retries permitted until 2026-09-13 19:14:22.206190614 +0000 UTC m=+631.673751794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6b5ce730-3540-41e8-a91a-55443cb9635e-tls-certs") pod "model-serving-api-54d89bd5fc-wb9rl" (UID: "6b5ce730-3540-41e8-a91a-55443cb9635e") : secret "model-serving-api-tls" not found Sep 13 19:14:21.718632 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.718604 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjsf\" (UniqueName: \"kubernetes.io/projected/6b5ce730-3540-41e8-a91a-55443cb9635e-kube-api-access-ltjsf\") pod \"model-serving-api-54d89bd5fc-wb9rl\" (UID: \"6b5ce730-3540-41e8-a91a-55443cb9635e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:21.750127 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.750089 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:21.850736 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.850623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:21.950569 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.950530 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:21.998212 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:21.998181 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl"] Sep 13 19:14:22.007422 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.007387 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.010418 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.010394 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c2ch5\"" Sep 13 19:14:22.010713 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.010556 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 13 19:14:22.010846 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.010819 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 13 19:14:22.010979 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.010962 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 13 19:14:22.012049 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.012027 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl"] Sep 13 19:14:22.029505 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.029483 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:22.109028 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.108940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.109174 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.109067 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.109174 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.109099 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c430a447-23d2-438d-bf92-91e244724081-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.109174 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.109127 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.109313 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.109197 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.109313 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.109238 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c430a447-23d2-438d-bf92-91e244724081-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.109313 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.109277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6ff8\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-kube-api-access-t6ff8\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.109417 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.109318 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.109417 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.109387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210404 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210404 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210440 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b5ce730-3540-41e8-a91a-55443cb9635e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wb9rl\" (UID: \"6b5ce730-3540-41e8-a91a-55443cb9635e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:22.210898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210548 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210598 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c430a447-23d2-438d-bf92-91e244724081-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c430a447-23d2-438d-bf92-91e244724081-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6ff8\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-kube-api-access-t6ff8\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.210898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.211265 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210971 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.211265 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.210998 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.211265 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.211054 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.211265 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.211146 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.211433 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.211407 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c430a447-23d2-438d-bf92-91e244724081-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.213434 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.213400 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b5ce730-3540-41e8-a91a-55443cb9635e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wb9rl\" (UID: \"6b5ce730-3540-41e8-a91a-55443cb9635e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:22.213434 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.213411 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.214003 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.213981 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c430a447-23d2-438d-bf92-91e244724081-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.217861 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.217839 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6ff8\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-kube-api-access-t6ff8\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.218388 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.218372 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc9vknl\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.247384 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.247358 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:22.319855 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.319819 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:22.473898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.473862 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:22.495660 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.495622 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:22.604747 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.604723 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl"] Sep 13 19:14:22.606718 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:14:22.606666 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc430a447_23d2_438d_bf92_91e244724081.slice/crio-00e549417bf3a5b70f14ac34f21f360ad933cac7095814dd617c36ea58fa8412 WatchSource:0}: Error finding container 00e549417bf3a5b70f14ac34f21f360ad933cac7095814dd617c36ea58fa8412: Status 404 returned error can't find the container with id 00e549417bf3a5b70f14ac34f21f360ad933cac7095814dd617c36ea58fa8412 Sep 13 19:14:22.742957 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:22.742929 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wb9rl"] Sep 13 19:14:22.744812 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:14:22.744782 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5ce730_3540_41e8_a91a_55443cb9635e.slice/crio-fcb7cb620faaec014a6cb9fcf3bbb7d901430b22ce7f936ed3e1dd27d8f13e27 WatchSource:0}: Error finding container fcb7cb620faaec014a6cb9fcf3bbb7d901430b22ce7f936ed3e1dd27d8f13e27: Status 404 returned error can't find the container with id fcb7cb620faaec014a6cb9fcf3bbb7d901430b22ce7f936ed3e1dd27d8f13e27 Sep 13 19:14:23.318231 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:23.318189 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" event={"ID":"6b5ce730-3540-41e8-a91a-55443cb9635e","Type":"ContainerStarted","Data":"fcb7cb620faaec014a6cb9fcf3bbb7d901430b22ce7f936ed3e1dd27d8f13e27"} Sep 13 19:14:23.319481 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:23.319453 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" event={"ID":"c430a447-23d2-438d-bf92-91e244724081","Type":"ContainerStarted","Data":"00e549417bf3a5b70f14ac34f21f360ad933cac7095814dd617c36ea58fa8412"} Sep 13 19:14:26.408750 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:26.408713 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 19:14:26.409062 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:26.408789 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 19:14:26.409062 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:26.408818 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 19:14:27.341661 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:27.341621 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" event={"ID":"6b5ce730-3540-41e8-a91a-55443cb9635e","Type":"ContainerStarted","Data":"4301238d2e73706580071afda07020cbf018c7a7b9f27e789e5c13c54397117b"} Sep 13 19:14:27.341859 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:27.341704 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:27.343161 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:27.343132 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" event={"ID":"c430a447-23d2-438d-bf92-91e244724081","Type":"ContainerStarted","Data":"cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546"} Sep 13 19:14:27.358422 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:27.358370 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" podStartSLOduration=2.706172343 podStartE2EDuration="6.358355788s" totalImagesPullingTime="3.652183445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:14:27.356510838 +0000 UTC m=+636.824072025" watchObservedRunningTime="2026-09-13 19:14:27.358355788 +0000 UTC m=+636.825916998" Sep 13 19:14:27.376044 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:27.375995 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" podStartSLOduration=2.576324977 podStartE2EDuration="6.375982034s" totalImagesPullingTime="3.799657057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:14:27.374327463 +0000 UTC m=+636.841888645" watchObservedRunningTime="2026-09-13 19:14:27.375982034 +0000 UTC m=+636.843543222" Sep 13 19:14:27.731302 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:27.731215 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl"] Sep 13 19:14:28.320354 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.320321 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:28.321584 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.321560 2555 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Sep 13 19:14:28.321648 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.321626 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" podUID="c430a447-23d2-438d-bf92-91e244724081" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Sep 13 19:14:28.408898 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.408865 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99"] Sep 13 19:14:28.411976 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.411958 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.415383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.415363 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 13 19:14:28.415493 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.415383 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 13 19:14:28.415493 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.415427 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jxwjh\"" Sep 13 19:14:28.416045 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.416025 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 13 19:14:28.438491 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.438463 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99"] Sep 13 19:14:28.461930 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.461893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.462073 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.461945 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.462073 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.462057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8fkg\" (UniqueName: \"kubernetes.io/projected/2eb64d1e-3442-46d1-9c15-8b4023e0b994-kube-api-access-h8fkg\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.462192 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.462108 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb64d1e-3442-46d1-9c15-8b4023e0b994-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.462192 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.462138 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.462312 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.462284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.462377 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.462334 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.563270 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.563227 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb64d1e-3442-46d1-9c15-8b4023e0b994-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.563270 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.563260 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.563530 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.563282 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.563530 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.563404 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.563530 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.563490 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.563530 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.563526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.563782 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.563578 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8fkg\" (UniqueName: \"kubernetes.io/projected/2eb64d1e-3442-46d1-9c15-8b4023e0b994-kube-api-access-h8fkg\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.564073 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.564043 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.565781 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.565756 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.565937 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.565914 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.565989 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.565928 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb64d1e-3442-46d1-9c15-8b4023e0b994-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.566149 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.566128 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.571817 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.571764 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb64d1e-3442-46d1-9c15-8b4023e0b994-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.571960 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.571941 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8fkg\" (UniqueName: \"kubernetes.io/projected/2eb64d1e-3442-46d1-9c15-8b4023e0b994-kube-api-access-h8fkg\") pod \"istiod-openshift-gateway-5677ccb49b-lkr99\" (UID: \"2eb64d1e-3442-46d1-9c15-8b4023e0b994\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.721318 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.721285 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:28.998652 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:28.998628 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99"] Sep 13 19:14:29.000483 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:14:29.000456 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb64d1e_3442_46d1_9c15_8b4023e0b994.slice/crio-595cc7d20b64793bade9c9020fedc5502150e71deac09ac8cff2956e79ce18ab WatchSource:0}: Error finding container 595cc7d20b64793bade9c9020fedc5502150e71deac09ac8cff2956e79ce18ab: Status 404 returned error can't find the container with id 595cc7d20b64793bade9c9020fedc5502150e71deac09ac8cff2956e79ce18ab Sep 13 19:14:29.320970 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:29.320884 2555 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Sep 13 19:14:29.320970 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:29.320950 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" podUID="c430a447-23d2-438d-bf92-91e244724081" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Sep 13 19:14:29.353527 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:29.353489 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" event={"ID":"2eb64d1e-3442-46d1-9c15-8b4023e0b994","Type":"ContainerStarted","Data":"595cc7d20b64793bade9c9020fedc5502150e71deac09ac8cff2956e79ce18ab"} Sep 13 19:14:29.353732 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:29.353606 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" podUID="c430a447-23d2-438d-bf92-91e244724081" containerName="istio-proxy" containerID="cri-o://cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546" gracePeriod=30 Sep 13 19:14:30.711056 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:30.710974 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:30.796002 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:30.795943 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:30.963390 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:30.963312 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:31.071781 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:31.071736 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:31.172295 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:31.172242 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:14:31.305101 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:31.305064 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 19:14:31.305191 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:31.305134 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 19:14:32.368832 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:32.368778 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" event={"ID":"2eb64d1e-3442-46d1-9c15-8b4023e0b994","Type":"ContainerStarted","Data":"60116f06d3e54f19cfbcf46204cbaa62d24c2059ab18ba42bc9bb47c1977ddae"} Sep 13 19:14:32.369254 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:32.368899 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:32.370458 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:32.370433 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-lkr99 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 13 19:14:32.370567 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:32.370473 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" podUID="2eb64d1e-3442-46d1-9c15-8b4023e0b994" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 13 19:14:32.417298 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:32.417244 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" podStartSLOduration=2.118119068 podStartE2EDuration="4.417225467s" totalImagesPullingTime="2.299106399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:14:32.411800251 +0000 UTC m=+641.879361440" watchObservedRunningTime="2026-09-13 19:14:32.417225467 +0000 UTC m=+641.884786656" Sep 13 19:14:33.374424 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:33.374396 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lkr99" Sep 13 19:14:34.585621 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.585599 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:34.713999 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.713919 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-envoy\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.713999 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.713952 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-socket\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.713999 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.713989 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6ff8\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-kube-api-access-t6ff8\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.714259 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714024 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-credential-socket\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.714259 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714059 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c430a447-23d2-438d-bf92-91e244724081-istio-podinfo\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.714259 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714077 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c430a447-23d2-438d-bf92-91e244724081-istiod-ca-cert\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.714259 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714091 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-data\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.714259 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714123 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-istio-token\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.714259 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714151 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-certs\") pod \"c430a447-23d2-438d-bf92-91e244724081\" (UID: \"c430a447-23d2-438d-bf92-91e244724081\") " Sep 13 19:14:34.714542 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714256 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:14:34.714542 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714403 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-socket\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:34.714542 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714398 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-data" (OuterVolumeSpecName: "istio-data") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:14:34.714542 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714414 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:14:34.714542 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714467 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c430a447-23d2-438d-bf92-91e244724081-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 19:14:34.714846 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.714705 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:14:34.716336 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.716308 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:14:34.716435 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.716368 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-kube-api-access-t6ff8" (OuterVolumeSpecName: "kube-api-access-t6ff8") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "kube-api-access-t6ff8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:14:34.716657 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.716643 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-istio-token" (OuterVolumeSpecName: "istio-token") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:14:34.716771 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.716757 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c430a447-23d2-438d-bf92-91e244724081-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c430a447-23d2-438d-bf92-91e244724081" (UID: "c430a447-23d2-438d-bf92-91e244724081"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 13 19:14:34.815620 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.815573 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6ff8\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-kube-api-access-t6ff8\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:34.815620 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.815613 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-credential-socket\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:34.815620 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.815625 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c430a447-23d2-438d-bf92-91e244724081-istio-podinfo\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:34.815620 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.815633 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c430a447-23d2-438d-bf92-91e244724081-istiod-ca-cert\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:34.815905 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.815643 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-data\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:34.815905 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.815652 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c430a447-23d2-438d-bf92-91e244724081-istio-token\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:34.815905 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.815660 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-workload-certs\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:34.815905 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:34.815667 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c430a447-23d2-438d-bf92-91e244724081-istio-envoy\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:14:35.383543 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.383454 2555 generic.go:356] "Generic (PLEG): container finished" podID="c430a447-23d2-438d-bf92-91e244724081" containerID="cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546" exitCode=0 Sep 13 19:14:35.383543 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.383518 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" Sep 13 19:14:35.383749 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.383541 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" event={"ID":"c430a447-23d2-438d-bf92-91e244724081","Type":"ContainerDied","Data":"cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546"} Sep 13 19:14:35.383749 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.383613 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl" event={"ID":"c430a447-23d2-438d-bf92-91e244724081","Type":"ContainerDied","Data":"00e549417bf3a5b70f14ac34f21f360ad933cac7095814dd617c36ea58fa8412"} Sep 13 19:14:35.383749 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.383645 2555 scope.go:117] "RemoveContainer" containerID="cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546" Sep 13 19:14:35.393996 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.393973 2555 scope.go:117] "RemoveContainer" containerID="cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546" Sep 13 19:14:35.397474 ip-10-0-129-197 kubenswrapper[2555]: E0913 19:14:35.397435 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546\": container with ID starting with cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546 not found: ID does not exist" containerID="cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546" Sep 13 19:14:35.397655 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.397629 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546"} err="failed to get container status \"cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546\": rpc error: code = NotFound desc = could not find container \"cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546\": container with ID starting with cd138306d666906581471cfb72b88eb9a08b3936f1527c6f08b85e8e859c0546 not found: ID does not exist" Sep 13 19:14:35.403571 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.403548 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl"] Sep 13 19:14:35.406852 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:35.406830 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc9vknl"] Sep 13 19:14:37.009156 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:37.009120 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c430a447-23d2-438d-bf92-91e244724081" path="/var/lib/kubelet/pods/c430a447-23d2-438d-bf92-91e244724081/volumes" Sep 13 19:14:38.351769 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:38.351734 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wb9rl" Sep 13 19:14:40.557834 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:14:40.557801 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:22.320477 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:22.320421 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:22.378061 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:22.378029 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:25.668351 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.668315 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk"] Sep 13 19:15:25.668741 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.668576 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c430a447-23d2-438d-bf92-91e244724081" containerName="istio-proxy" Sep 13 19:15:25.668741 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.668586 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c430a447-23d2-438d-bf92-91e244724081" containerName="istio-proxy" Sep 13 19:15:25.668741 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.668641 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c430a447-23d2-438d-bf92-91e244724081" containerName="istio-proxy" Sep 13 19:15:25.670890 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.670868 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.673249 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.673222 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 13 19:15:25.673351 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.673257 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 13 19:15:25.673351 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.673266 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d96bt\"" Sep 13 19:15:25.679563 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.679542 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk"] Sep 13 19:15:25.696417 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.696393 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.696499 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.696453 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.696541 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.696506 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbsrf\" (UniqueName: \"kubernetes.io/projected/08a6f837-5d75-4e1b-9613-e160185ff8e6-kube-api-access-pbsrf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.765431 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.765397 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s"] Sep 13 19:15:25.767380 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.767358 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.776030 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.776010 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s"] Sep 13 19:15:25.797206 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.797182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.797321 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.797212 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbktn\" (UniqueName: \"kubernetes.io/projected/1801d789-b840-4409-9227-3a27433b8087-kube-api-access-sbktn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.797321 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.797236 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.797321 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.797260 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbsrf\" (UniqueName: \"kubernetes.io/projected/08a6f837-5d75-4e1b-9613-e160185ff8e6-kube-api-access-pbsrf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.797427 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.797350 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.797427 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.797404 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.797568 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.797553 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.797712 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.797672 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.805032 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.805006 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbsrf\" (UniqueName: \"kubernetes.io/projected/08a6f837-5d75-4e1b-9613-e160185ff8e6-kube-api-access-pbsrf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.865353 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.865324 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq"] Sep 13 19:15:25.867500 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.867481 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:25.875626 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.875600 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq"] Sep 13 19:15:25.898115 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.898089 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99dcd\" (UniqueName: \"kubernetes.io/projected/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-kube-api-access-99dcd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:25.898229 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.898128 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.898229 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.898165 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:25.898313 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.898263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:25.898313 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.898302 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.898386 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.898344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbktn\" (UniqueName: \"kubernetes.io/projected/1801d789-b840-4409-9227-3a27433b8087-kube-api-access-sbktn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.898450 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.898434 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.898602 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.898584 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.905586 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.905557 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbktn\" (UniqueName: \"kubernetes.io/projected/1801d789-b840-4409-9227-3a27433b8087-kube-api-access-sbktn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:25.970004 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.969927 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd"] Sep 13 19:15:25.972283 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.972263 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:25.980353 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.980328 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:25.982390 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.982366 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd"] Sep 13 19:15:25.999051 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.999026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgxp7\" (UniqueName: \"kubernetes.io/projected/c42bdb74-1a25-408e-a340-4ced8c0fb054-kube-api-access-sgxp7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:25.999180 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.999079 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:25.999180 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.999116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:25.999180 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.999160 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:25.999354 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.999220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99dcd\" (UniqueName: \"kubernetes.io/projected/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-kube-api-access-99dcd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:25.999354 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.999250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:25.999459 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.999382 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:25.999459 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:25.999406 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:26.006435 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.006412 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99dcd\" (UniqueName: \"kubernetes.io/projected/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-kube-api-access-99dcd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:26.077049 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.077017 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:26.100589 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.100558 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:26.100780 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.100628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:26.100780 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.100769 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgxp7\" (UniqueName: \"kubernetes.io/projected/c42bdb74-1a25-408e-a340-4ced8c0fb054-kube-api-access-sgxp7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:26.101087 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.101061 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:26.101087 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.101076 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:26.108560 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.108529 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgxp7\" (UniqueName: \"kubernetes.io/projected/c42bdb74-1a25-408e-a340-4ced8c0fb054-kube-api-access-sgxp7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:26.177743 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.177695 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:26.253133 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.253107 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk"] Sep 13 19:15:26.255594 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:15:26.255562 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a6f837_5d75_4e1b_9613_e160185ff8e6.slice/crio-7e21185ed823ea936435a2d9a2deb03fa0af522491ee4faefd8c15e9391cb73e WatchSource:0}: Error finding container 7e21185ed823ea936435a2d9a2deb03fa0af522491ee4faefd8c15e9391cb73e: Status 404 returned error can't find the container with id 7e21185ed823ea936435a2d9a2deb03fa0af522491ee4faefd8c15e9391cb73e Sep 13 19:15:26.281494 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.281462 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:26.349872 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.349782 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s"] Sep 13 19:15:26.354780 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:15:26.354751 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1801d789_b840_4409_9227_3a27433b8087.slice/crio-5b67c8b0193fd143a1ddcdaf5931dba59f20f8bea115e71e158452beb5859334 WatchSource:0}: Error finding container 5b67c8b0193fd143a1ddcdaf5931dba59f20f8bea115e71e158452beb5859334: Status 404 returned error can't find the container with id 5b67c8b0193fd143a1ddcdaf5931dba59f20f8bea115e71e158452beb5859334 Sep 13 19:15:26.444446 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.444420 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq"] Sep 13 19:15:26.460377 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:15:26.460351 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1675bf26_709e_47ec_bfc7_0a7ee8e3b6b1.slice/crio-097f8d29851b5a7d09b6aefe6ef28e5b0ecb351b0d810646421c553fe069e223 WatchSource:0}: Error finding container 097f8d29851b5a7d09b6aefe6ef28e5b0ecb351b0d810646421c553fe069e223: Status 404 returned error can't find the container with id 097f8d29851b5a7d09b6aefe6ef28e5b0ecb351b0d810646421c553fe069e223 Sep 13 19:15:26.554314 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.554284 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd"] Sep 13 19:15:26.609367 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.609337 2555 generic.go:356] "Generic (PLEG): container finished" podID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerID="570b9e7ab87c724f688516d5f55793b8039bbc86ab39b5c62aefff8fefba08d2" exitCode=0 Sep 13 19:15:26.609503 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.609411 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" event={"ID":"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1","Type":"ContainerDied","Data":"570b9e7ab87c724f688516d5f55793b8039bbc86ab39b5c62aefff8fefba08d2"} Sep 13 19:15:26.609503 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.609463 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" event={"ID":"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1","Type":"ContainerStarted","Data":"097f8d29851b5a7d09b6aefe6ef28e5b0ecb351b0d810646421c553fe069e223"} Sep 13 19:15:26.610503 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.610486 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 19:15:26.611207 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.611181 2555 generic.go:356] "Generic (PLEG): container finished" podID="1801d789-b840-4409-9227-3a27433b8087" containerID="c59d34251eb7fd6b173b16ec5920af7ecfac70c5c0c76baea66c9bf5f96f755a" exitCode=0 Sep 13 19:15:26.611307 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.611281 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" event={"ID":"1801d789-b840-4409-9227-3a27433b8087","Type":"ContainerDied","Data":"c59d34251eb7fd6b173b16ec5920af7ecfac70c5c0c76baea66c9bf5f96f755a"} Sep 13 19:15:26.611419 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.611324 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" event={"ID":"1801d789-b840-4409-9227-3a27433b8087","Type":"ContainerStarted","Data":"5b67c8b0193fd143a1ddcdaf5931dba59f20f8bea115e71e158452beb5859334"} Sep 13 19:15:26.611932 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:15:26.611859 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42bdb74_1a25_408e_a340_4ced8c0fb054.slice/crio-f3096f94a1638c52a3b8d6f7b677d2de969c0f516b78e7849cc60191125b2c7e WatchSource:0}: Error finding container f3096f94a1638c52a3b8d6f7b677d2de969c0f516b78e7849cc60191125b2c7e: Status 404 returned error can't find the container with id f3096f94a1638c52a3b8d6f7b677d2de969c0f516b78e7849cc60191125b2c7e Sep 13 19:15:26.613573 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.613470 2555 generic.go:356] "Generic (PLEG): container finished" podID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerID="b83eb4068cd73bb913e79365bb23422b73c58028f5c34b50c98389b38f6c955c" exitCode=0 Sep 13 19:15:26.613573 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.613553 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" event={"ID":"08a6f837-5d75-4e1b-9613-e160185ff8e6","Type":"ContainerDied","Data":"b83eb4068cd73bb913e79365bb23422b73c58028f5c34b50c98389b38f6c955c"} Sep 13 19:15:26.613653 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:26.613604 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" event={"ID":"08a6f837-5d75-4e1b-9613-e160185ff8e6","Type":"ContainerStarted","Data":"7e21185ed823ea936435a2d9a2deb03fa0af522491ee4faefd8c15e9391cb73e"} Sep 13 19:15:27.619042 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:27.619015 2555 generic.go:356] "Generic (PLEG): container finished" podID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerID="c2dd43d15e0b14b85bee2b743b822f9b0ae78c570a7df75a0f26057df13b15fa" exitCode=0 Sep 13 19:15:27.619308 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:27.619074 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" event={"ID":"c42bdb74-1a25-408e-a340-4ced8c0fb054","Type":"ContainerDied","Data":"c2dd43d15e0b14b85bee2b743b822f9b0ae78c570a7df75a0f26057df13b15fa"} Sep 13 19:15:27.619308 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:27.619116 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" event={"ID":"c42bdb74-1a25-408e-a340-4ced8c0fb054","Type":"ContainerStarted","Data":"f3096f94a1638c52a3b8d6f7b677d2de969c0f516b78e7849cc60191125b2c7e"} Sep 13 19:15:28.624938 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:28.624906 2555 generic.go:356] "Generic (PLEG): container finished" podID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerID="5e084524777db328f8741e48853cd34259591f44bcf48bbc8ce4adf67be4b926" exitCode=0 Sep 13 19:15:28.625381 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:28.624986 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" event={"ID":"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1","Type":"ContainerDied","Data":"5e084524777db328f8741e48853cd34259591f44bcf48bbc8ce4adf67be4b926"} Sep 13 19:15:28.627015 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:28.626992 2555 generic.go:356] "Generic (PLEG): container finished" podID="1801d789-b840-4409-9227-3a27433b8087" containerID="fffd1fbba8b86ab1ea0547e96b32e9d28c96b4edcc2f4921314bee69f6363796" exitCode=0 Sep 13 19:15:28.627110 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:28.627061 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" event={"ID":"1801d789-b840-4409-9227-3a27433b8087","Type":"ContainerDied","Data":"fffd1fbba8b86ab1ea0547e96b32e9d28c96b4edcc2f4921314bee69f6363796"} Sep 13 19:15:28.629124 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:28.629104 2555 generic.go:356] "Generic (PLEG): container finished" podID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerID="2257ac130665497080be3a6d488c09d689bf4bd48e9bb86ed7499129c95d9816" exitCode=0 Sep 13 19:15:28.629205 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:28.629155 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" event={"ID":"08a6f837-5d75-4e1b-9613-e160185ff8e6","Type":"ContainerDied","Data":"2257ac130665497080be3a6d488c09d689bf4bd48e9bb86ed7499129c95d9816"} Sep 13 19:15:29.636578 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:29.636537 2555 generic.go:356] "Generic (PLEG): container finished" podID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerID="7cc99cabd80a0e4e11cf9a0827de87ad031de99ff390b3e829559b02cad572c8" exitCode=0 Sep 13 19:15:29.636999 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:29.636621 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" event={"ID":"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1","Type":"ContainerDied","Data":"7cc99cabd80a0e4e11cf9a0827de87ad031de99ff390b3e829559b02cad572c8"} Sep 13 19:15:29.638717 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:29.638694 2555 generic.go:356] "Generic (PLEG): container finished" podID="1801d789-b840-4409-9227-3a27433b8087" containerID="08132d849d92010dc4f385588ce382d065b182228c12fb3d8df7509da3f32cf4" exitCode=0 Sep 13 19:15:29.638825 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:29.638721 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" event={"ID":"1801d789-b840-4409-9227-3a27433b8087","Type":"ContainerDied","Data":"08132d849d92010dc4f385588ce382d065b182228c12fb3d8df7509da3f32cf4"} Sep 13 19:15:29.642946 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:29.642925 2555 generic.go:356] "Generic (PLEG): container finished" podID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerID="5062247d655311bbf2ac1966b11e2a484e8e3e1923f3c72d20cd6c6a1281acee" exitCode=0 Sep 13 19:15:29.643038 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:29.643011 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" event={"ID":"c42bdb74-1a25-408e-a340-4ced8c0fb054","Type":"ContainerDied","Data":"5062247d655311bbf2ac1966b11e2a484e8e3e1923f3c72d20cd6c6a1281acee"} Sep 13 19:15:29.645353 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:29.645333 2555 generic.go:356] "Generic (PLEG): container finished" podID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerID="140db7ca6561aaaab1e98175e3fee02566b6be12e152c18382a97245be842a06" exitCode=0 Sep 13 19:15:29.645438 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:29.645401 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" event={"ID":"08a6f837-5d75-4e1b-9613-e160185ff8e6","Type":"ContainerDied","Data":"140db7ca6561aaaab1e98175e3fee02566b6be12e152c18382a97245be842a06"} Sep 13 19:15:30.651593 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.651560 2555 generic.go:356] "Generic (PLEG): container finished" podID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerID="a21b20acb29606aaa404e1c28741d9fbeded0ac736ed30d2b50019ab226fdc14" exitCode=0 Sep 13 19:15:30.652001 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.651651 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" event={"ID":"c42bdb74-1a25-408e-a340-4ced8c0fb054","Type":"ContainerDied","Data":"a21b20acb29606aaa404e1c28741d9fbeded0ac736ed30d2b50019ab226fdc14"} Sep 13 19:15:30.797743 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.797717 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:30.836490 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.836463 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbktn\" (UniqueName: \"kubernetes.io/projected/1801d789-b840-4409-9227-3a27433b8087-kube-api-access-sbktn\") pod \"1801d789-b840-4409-9227-3a27433b8087\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " Sep 13 19:15:30.836610 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.836538 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-bundle\") pod \"1801d789-b840-4409-9227-3a27433b8087\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " Sep 13 19:15:30.836610 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.836593 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-util\") pod \"1801d789-b840-4409-9227-3a27433b8087\" (UID: \"1801d789-b840-4409-9227-3a27433b8087\") " Sep 13 19:15:30.837166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.837139 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-bundle" (OuterVolumeSpecName: "bundle") pod "1801d789-b840-4409-9227-3a27433b8087" (UID: "1801d789-b840-4409-9227-3a27433b8087"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:15:30.838919 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.838889 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1801d789-b840-4409-9227-3a27433b8087-kube-api-access-sbktn" (OuterVolumeSpecName: "kube-api-access-sbktn") pod "1801d789-b840-4409-9227-3a27433b8087" (UID: "1801d789-b840-4409-9227-3a27433b8087"). InnerVolumeSpecName "kube-api-access-sbktn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:15:30.841041 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.841019 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:30.842878 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.842854 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-util" (OuterVolumeSpecName: "util") pod "1801d789-b840-4409-9227-3a27433b8087" (UID: "1801d789-b840-4409-9227-3a27433b8087"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:15:30.843568 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.843553 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:30.937314 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937225 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-bundle\") pod \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " Sep 13 19:15:30.937314 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937272 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-util\") pod \"08a6f837-5d75-4e1b-9613-e160185ff8e6\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " Sep 13 19:15:30.937520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937340 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-util\") pod \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " Sep 13 19:15:30.937520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937376 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99dcd\" (UniqueName: \"kubernetes.io/projected/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-kube-api-access-99dcd\") pod \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\" (UID: \"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1\") " Sep 13 19:15:30.937520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937407 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-bundle\") pod \"08a6f837-5d75-4e1b-9613-e160185ff8e6\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " Sep 13 19:15:30.937520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937435 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbsrf\" (UniqueName: \"kubernetes.io/projected/08a6f837-5d75-4e1b-9613-e160185ff8e6-kube-api-access-pbsrf\") pod \"08a6f837-5d75-4e1b-9613-e160185ff8e6\" (UID: \"08a6f837-5d75-4e1b-9613-e160185ff8e6\") " Sep 13 19:15:30.937742 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937629 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-util\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:30.937742 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937647 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbktn\" (UniqueName: \"kubernetes.io/projected/1801d789-b840-4409-9227-3a27433b8087-kube-api-access-sbktn\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:30.937742 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937662 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1801d789-b840-4409-9227-3a27433b8087-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:30.937964 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.937935 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-bundle" (OuterVolumeSpecName: "bundle") pod "08a6f837-5d75-4e1b-9613-e160185ff8e6" (UID: "08a6f837-5d75-4e1b-9613-e160185ff8e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:15:30.938033 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.938012 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-bundle" (OuterVolumeSpecName: "bundle") pod "1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" (UID: "1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:15:30.939605 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.939577 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a6f837-5d75-4e1b-9613-e160185ff8e6-kube-api-access-pbsrf" (OuterVolumeSpecName: "kube-api-access-pbsrf") pod "08a6f837-5d75-4e1b-9613-e160185ff8e6" (UID: "08a6f837-5d75-4e1b-9613-e160185ff8e6"). InnerVolumeSpecName "kube-api-access-pbsrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:15:30.939605 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.939596 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-kube-api-access-99dcd" (OuterVolumeSpecName: "kube-api-access-99dcd") pod "1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" (UID: "1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1"). InnerVolumeSpecName "kube-api-access-99dcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:15:30.942925 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.942892 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-util" (OuterVolumeSpecName: "util") pod "1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" (UID: "1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:15:30.943093 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:30.943069 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-util" (OuterVolumeSpecName: "util") pod "08a6f837-5d75-4e1b-9613-e160185ff8e6" (UID: "08a6f837-5d75-4e1b-9613-e160185ff8e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:15:31.038628 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.038598 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99dcd\" (UniqueName: \"kubernetes.io/projected/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-kube-api-access-99dcd\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:31.038628 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.038627 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:31.038803 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.038642 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbsrf\" (UniqueName: \"kubernetes.io/projected/08a6f837-5d75-4e1b-9613-e160185ff8e6-kube-api-access-pbsrf\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:31.038803 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.038654 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:31.038803 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.038666 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a6f837-5d75-4e1b-9613-e160185ff8e6-util\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:31.038803 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.038689 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1-util\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:31.273869 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.273819 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:31.658425 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.658336 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" Sep 13 19:15:31.658913 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.658336 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5xk6s" event={"ID":"1801d789-b840-4409-9227-3a27433b8087","Type":"ContainerDied","Data":"5b67c8b0193fd143a1ddcdaf5931dba59f20f8bea115e71e158452beb5859334"} Sep 13 19:15:31.658913 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.658473 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b67c8b0193fd143a1ddcdaf5931dba59f20f8bea115e71e158452beb5859334" Sep 13 19:15:31.660497 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.660470 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" Sep 13 19:15:31.660610 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.660495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6n8wbk" event={"ID":"08a6f837-5d75-4e1b-9613-e160185ff8e6","Type":"ContainerDied","Data":"7e21185ed823ea936435a2d9a2deb03fa0af522491ee4faefd8c15e9391cb73e"} Sep 13 19:15:31.660610 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.660540 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e21185ed823ea936435a2d9a2deb03fa0af522491ee4faefd8c15e9391cb73e" Sep 13 19:15:31.662397 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.662374 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" event={"ID":"1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1","Type":"ContainerDied","Data":"097f8d29851b5a7d09b6aefe6ef28e5b0ecb351b0d810646421c553fe069e223"} Sep 13 19:15:31.662512 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.662438 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cnjgq" Sep 13 19:15:31.662512 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.662439 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="097f8d29851b5a7d09b6aefe6ef28e5b0ecb351b0d810646421c553fe069e223" Sep 13 19:15:31.779520 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.779494 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:31.846100 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.846064 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgxp7\" (UniqueName: \"kubernetes.io/projected/c42bdb74-1a25-408e-a340-4ced8c0fb054-kube-api-access-sgxp7\") pod \"c42bdb74-1a25-408e-a340-4ced8c0fb054\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " Sep 13 19:15:31.846299 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.846118 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-util\") pod \"c42bdb74-1a25-408e-a340-4ced8c0fb054\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " Sep 13 19:15:31.846299 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.846172 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-bundle\") pod \"c42bdb74-1a25-408e-a340-4ced8c0fb054\" (UID: \"c42bdb74-1a25-408e-a340-4ced8c0fb054\") " Sep 13 19:15:31.846831 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.846806 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-bundle" (OuterVolumeSpecName: "bundle") pod "c42bdb74-1a25-408e-a340-4ced8c0fb054" (UID: "c42bdb74-1a25-408e-a340-4ced8c0fb054"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:15:31.848191 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.848170 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c42bdb74-1a25-408e-a340-4ced8c0fb054-kube-api-access-sgxp7" (OuterVolumeSpecName: "kube-api-access-sgxp7") pod "c42bdb74-1a25-408e-a340-4ced8c0fb054" (UID: "c42bdb74-1a25-408e-a340-4ced8c0fb054"). InnerVolumeSpecName "kube-api-access-sgxp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 19:15:31.911060 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.910969 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-util" (OuterVolumeSpecName: "util") pod "c42bdb74-1a25-408e-a340-4ced8c0fb054" (UID: "c42bdb74-1a25-408e-a340-4ced8c0fb054"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 19:15:31.947227 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.947194 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-util\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:31.947227 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.947223 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c42bdb74-1a25-408e-a340-4ced8c0fb054-bundle\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:31.947377 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:31.947235 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgxp7\" (UniqueName: \"kubernetes.io/projected/c42bdb74-1a25-408e-a340-4ced8c0fb054-kube-api-access-sgxp7\") on node \"ip-10-0-129-197.ec2.internal\" DevicePath \"\"" Sep 13 19:15:32.520302 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:32.520266 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:32.669166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:32.669130 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" event={"ID":"c42bdb74-1a25-408e-a340-4ced8c0fb054","Type":"ContainerDied","Data":"f3096f94a1638c52a3b8d6f7b677d2de969c0f516b78e7849cc60191125b2c7e"} Sep 13 19:15:32.669531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:32.669174 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abc8wd" Sep 13 19:15:32.669531 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:32.669188 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3096f94a1638c52a3b8d6f7b677d2de969c0f516b78e7849cc60191125b2c7e" Sep 13 19:15:34.468825 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:34.468786 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:35.468341 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:35.468314 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:39.443631 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:39.443597 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:39.543009 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:39.542976 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:39.875541 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:39.875504 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:41.351964 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:41.351925 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:41.400652 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:41.400618 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:42.957005 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:42.956968 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:45.466379 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:45.466303 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:46.081975 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:46.081944 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:46.658541 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:46.658513 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:57.784735 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:57.784670 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:15:58.159047 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:15:58.158970 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:00.304091 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:00.304057 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:01.907288 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:01.907254 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:02.707300 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:02.707255 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:03.318924 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:03.318890 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:03.421336 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:03.421284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:04.117615 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:04.117580 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:04.202367 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:04.202339 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:05.673399 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:05.673361 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:05.722230 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:05.722203 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:06.474304 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:06.474267 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:06.528906 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:06.528872 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:06.873616 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:06.873585 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:06.926018 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:06.925991 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:14.084785 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:14.084745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:14.136234 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:14.136210 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:14.286351 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:14.286317 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:14.338707 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:14.338632 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:16.244301 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:16.244254 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:16.344729 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:16.344662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:18.688253 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:18.688217 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:18.746087 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:18.746058 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:25.195874 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:25.195806 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:25.294659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:25.294592 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:27.962608 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:27.962573 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:33.050170 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:33.050099 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:33.099611 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:33.099572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:33.642838 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:33.642806 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:33.744378 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:33.744340 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:37.048848 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:37.048807 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:37.145021 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:37.144986 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:37.789010 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:37.788977 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:38.251388 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:38.251344 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:39.447831 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:39.447796 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:39.548352 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:39.548304 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:45.190029 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:45.189994 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:45.289092 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:45.289055 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:45.390077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:45.390040 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:51.909040 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:51.909001 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:52.017863 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.017821 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:52.071197 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.071154 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:52.211217 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211152 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:16:52.211430 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211418 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerName="extract" Sep 13 19:16:52.211473 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211431 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerName="extract" Sep 13 19:16:52.211473 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211445 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1801d789-b840-4409-9227-3a27433b8087" containerName="pull" Sep 13 19:16:52.211473 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211451 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1801d789-b840-4409-9227-3a27433b8087" containerName="pull" Sep 13 19:16:52.211473 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211458 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerName="util" Sep 13 19:16:52.211473 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211463 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerName="util" Sep 13 19:16:52.211473 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211469 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1801d789-b840-4409-9227-3a27433b8087" containerName="extract" Sep 13 19:16:52.211473 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211474 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1801d789-b840-4409-9227-3a27433b8087" containerName="extract" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211482 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerName="util" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211486 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerName="util" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211493 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerName="pull" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211498 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerName="pull" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211506 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1801d789-b840-4409-9227-3a27433b8087" containerName="util" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211512 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1801d789-b840-4409-9227-3a27433b8087" containerName="util" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211517 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerName="pull" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211522 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerName="pull" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211530 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerName="util" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211535 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerName="util" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211540 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerName="pull" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211545 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerName="pull" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211551 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerName="extract" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211556 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerName="extract" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211561 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerName="extract" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211566 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerName="extract" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211622 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c42bdb74-1a25-408e-a340-4ced8c0fb054" containerName="extract" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211630 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="08a6f837-5d75-4e1b-9613-e160185ff8e6" containerName="extract" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211635 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1801d789-b840-4409-9227-3a27433b8087" containerName="extract" Sep 13 19:16:52.211773 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.211641 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1675bf26-709e-47ec-bfc7-0a7ee8e3b6b1" containerName="extract" Sep 13 19:16:52.214252 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.214236 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:52.217080 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.217061 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-95phb\"" Sep 13 19:16:52.217329 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.217312 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 13 19:16:52.218245 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.218227 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 13 19:16:52.218310 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.218227 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 13 19:16:52.224588 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.224566 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:16:52.255322 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.255278 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:16:52.278442 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.278415 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h68n\" (UniqueName: \"kubernetes.io/projected/46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1-kube-api-access-5h68n\") pod \"limitador-limitador-84994f7ffc-x6s4z\" (UID: \"46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:52.278543 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.278460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1-config-file\") pod \"limitador-limitador-84994f7ffc-x6s4z\" (UID: \"46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:52.379418 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.379386 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h68n\" (UniqueName: \"kubernetes.io/projected/46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1-kube-api-access-5h68n\") pod \"limitador-limitador-84994f7ffc-x6s4z\" (UID: \"46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:52.379566 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.379453 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1-config-file\") pod \"limitador-limitador-84994f7ffc-x6s4z\" (UID: \"46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:52.380078 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.380055 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1-config-file\") pod \"limitador-limitador-84994f7ffc-x6s4z\" (UID: \"46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:52.386743 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.386724 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h68n\" (UniqueName: \"kubernetes.io/projected/46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1-kube-api-access-5h68n\") pod \"limitador-limitador-84994f7ffc-x6s4z\" (UID: \"46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:52.525341 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.525307 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:52.727053 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.727019 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:52.795892 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.795867 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:16:52.797518 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:52.797488 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:16:52.798090 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:16:52.798064 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ad0f4c_4f5d_4cdc_a80d_da161e4d7fe1.slice/crio-dc34f8fe7ef0b6e3e7c623209a095ae7bd2d1f5d17da24bab8697fdcf70d779f WatchSource:0}: Error finding container dc34f8fe7ef0b6e3e7c623209a095ae7bd2d1f5d17da24bab8697fdcf70d779f: Status 404 returned error can't find the container with id dc34f8fe7ef0b6e3e7c623209a095ae7bd2d1f5d17da24bab8697fdcf70d779f Sep 13 19:16:53.033981 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:53.033948 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" event={"ID":"46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1","Type":"ContainerStarted","Data":"dc34f8fe7ef0b6e3e7c623209a095ae7bd2d1f5d17da24bab8697fdcf70d779f"} Sep 13 19:16:55.044309 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:55.044274 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" event={"ID":"46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1","Type":"ContainerStarted","Data":"b432b4717ba411de8f10f6a7c12d6fc44599fa200c052051cf9dcc04a87630d1"} Sep 13 19:16:55.044722 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:55.044329 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:16:55.059166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:16:55.059114 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" podStartSLOduration=0.965012137 podStartE2EDuration="3.059099233s" totalImagesPullingTime="2.094087096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:16:55.057966151 +0000 UTC m=+784.525527343" watchObservedRunningTime="2026-09-13 19:16:55.059099233 +0000 UTC m=+784.526660422" Sep 13 19:17:06.051821 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:06.051791 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-x6s4z" Sep 13 19:17:11.974999 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:11.974951 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:12.033364 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:12.033332 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:12.475224 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:12.475168 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:22.956492 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:22.956391 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:23.056842 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:23.056790 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:30.621165 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:30.621129 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:30.720224 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:30.720190 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:30.771589 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:30.771552 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:31.058624 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:31.058592 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:31.155566 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:31.155533 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:34.697193 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:34.697149 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:34.765432 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:34.765403 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:52.466392 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:52.466354 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:17:52.516434 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:17:52.516397 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:06.186815 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:06.186776 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:06.285547 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:06.285510 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:07.828737 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:07.828704 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:07.930337 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:07.930301 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:08.287063 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:08.287020 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:08.390877 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:08.390842 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:08.495111 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:08.495074 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:18:08.576370 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:08.576289 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:19.955173 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:19.955138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:20.057422 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:20.057377 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:26.823268 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:26.823227 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:27.291942 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:27.291904 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:18:45.000382 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.000268 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv"] Sep 13 19:18:45.003856 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.003831 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.007591 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.007563 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cz9nj\"" Sep 13 19:18:45.007889 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.007863 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 13 19:18:45.008046 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.008027 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 13 19:18:45.008282 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.008263 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 13 19:18:45.014421 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.014397 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv"] Sep 13 19:18:45.086783 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.086750 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:18:45.095907 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.095882 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.095998 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.095923 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ncn8\" (UniqueName: \"kubernetes.io/projected/e32b9911-c7ba-481e-89ca-f4298c823582-kube-api-access-7ncn8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.095998 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.095948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.095998 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.095963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.096096 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.096023 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e32b9911-c7ba-481e-89ca-f4298c823582-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.096096 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.096048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.196540 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.196511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e32b9911-c7ba-481e-89ca-f4298c823582-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.196650 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.196552 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.196650 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.196573 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.196758 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.196707 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ncn8\" (UniqueName: \"kubernetes.io/projected/e32b9911-c7ba-481e-89ca-f4298c823582-kube-api-access-7ncn8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.196815 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.196770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.196815 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.196795 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.196925 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.196911 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.197102 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.197082 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.197164 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.197112 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.198727 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.198708 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e32b9911-c7ba-481e-89ca-f4298c823582-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.199028 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.199013 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e32b9911-c7ba-481e-89ca-f4298c823582-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.204117 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.204099 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ncn8\" (UniqueName: \"kubernetes.io/projected/e32b9911-c7ba-481e-89ca-f4298c823582-kube-api-access-7ncn8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x44zv\" (UID: \"e32b9911-c7ba-481e-89ca-f4298c823582\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.333020 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.332941 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:45.601227 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.601194 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv"] Sep 13 19:18:45.602836 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:18:45.602811 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32b9911_c7ba_481e_89ca_f4298c823582.slice/crio-0c4cfe71e1cb181245fdec358806578d036ed8c1e33ecb21f2c86fac27f8a020 WatchSource:0}: Error finding container 0c4cfe71e1cb181245fdec358806578d036ed8c1e33ecb21f2c86fac27f8a020: Status 404 returned error can't find the container with id 0c4cfe71e1cb181245fdec358806578d036ed8c1e33ecb21f2c86fac27f8a020 Sep 13 19:18:45.744973 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:45.744947 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:18:46.559383 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:46.559346 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" event={"ID":"e32b9911-c7ba-481e-89ca-f4298c823582","Type":"ContainerStarted","Data":"0c4cfe71e1cb181245fdec358806578d036ed8c1e33ecb21f2c86fac27f8a020"} Sep 13 19:18:47.566196 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:47.566160 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" event={"ID":"e32b9911-c7ba-481e-89ca-f4298c823582","Type":"ContainerStarted","Data":"f8381fce1193a85273d5b79e47df988ca5547b1af2fda7683e69ce786196d413"} Sep 13 19:18:47.585196 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:47.585148 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" podStartSLOduration=2.621751003 podStartE2EDuration="3.585133024s" totalImagesPullingTime="963.382021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:18:47.582580872 +0000 UTC m=+897.050142061" watchObservedRunningTime="2026-09-13 19:18:47.585133024 +0000 UTC m=+897.052694239" Sep 13 19:18:55.333418 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:55.333375 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:55.335907 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:55.333458 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:55.345961 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:55.345932 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:18:55.613906 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:18:55.613828 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x44zv" Sep 13 19:19:04.721573 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:04.721539 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:19:05.657444 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:05.657408 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:19:09.490427 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.490389 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7"] Sep 13 19:19:09.493768 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.493742 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.496026 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.496005 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 13 19:19:09.501989 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.501968 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7"] Sep 13 19:19:09.512229 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.512207 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:19:09.576321 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.576296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.576424 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.576326 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vvsd\" (UniqueName: \"kubernetes.io/projected/fee6d26b-10c0-4945-922b-37dd5cd3f56d-kube-api-access-7vvsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.576424 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.576350 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.576424 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.576386 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.576424 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.576401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fee6d26b-10c0-4945-922b-37dd5cd3f56d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.576599 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.576440 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677257 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677232 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677293 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vvsd\" (UniqueName: \"kubernetes.io/projected/fee6d26b-10c0-4945-922b-37dd5cd3f56d-kube-api-access-7vvsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677356 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677380 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677599 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fee6d26b-10c0-4945-922b-37dd5cd3f56d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677648 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677611 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677737 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677718 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.677799 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.677757 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.679909 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.679874 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fee6d26b-10c0-4945-922b-37dd5cd3f56d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.680126 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.680102 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fee6d26b-10c0-4945-922b-37dd5cd3f56d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.685499 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.685473 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vvsd\" (UniqueName: \"kubernetes.io/projected/fee6d26b-10c0-4945-922b-37dd5cd3f56d-kube-api-access-7vvsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t67b7\" (UID: \"fee6d26b-10c0-4945-922b-37dd5cd3f56d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:09.805062 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:09.805034 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:10.079199 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:10.079173 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7"] Sep 13 19:19:10.081419 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:19:10.081386 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee6d26b_10c0_4945_922b_37dd5cd3f56d.slice/crio-c51ac2b2953943aca05c0b0b6c83194be0fd7e7db8044d4b8730bb1bb7a4485f WatchSource:0}: Error finding container c51ac2b2953943aca05c0b0b6c83194be0fd7e7db8044d4b8730bb1bb7a4485f: Status 404 returned error can't find the container with id c51ac2b2953943aca05c0b0b6c83194be0fd7e7db8044d4b8730bb1bb7a4485f Sep 13 19:19:10.665395 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:10.665305 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:19:10.670990 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:10.670961 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" event={"ID":"fee6d26b-10c0-4945-922b-37dd5cd3f56d","Type":"ContainerStarted","Data":"ad50a976ee8ee228d913d19337915aad837523691ca9ec6b88393027a1188213"} Sep 13 19:19:10.671134 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:10.671003 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" event={"ID":"fee6d26b-10c0-4945-922b-37dd5cd3f56d","Type":"ContainerStarted","Data":"c51ac2b2953943aca05c0b0b6c83194be0fd7e7db8044d4b8730bb1bb7a4485f"} Sep 13 19:19:10.687152 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:10.687107 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" podStartSLOduration=1.479333472 podStartE2EDuration="1.687091252s" totalImagesPullingTime="207.75778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:19:10.685175684 +0000 UTC m=+920.152736875" watchObservedRunningTime="2026-09-13 19:19:10.687091252 +0000 UTC m=+920.154652438" Sep 13 19:19:19.806168 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:19.806136 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:19.806550 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:19.806197 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:19.818596 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:19.818568 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:20.730772 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:20.730743 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t67b7" Sep 13 19:19:23.130649 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:23.130614 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:19:24.761378 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:24.761344 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:19:37.397388 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.397356 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv"] Sep 13 19:19:37.400552 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.400536 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.403447 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.403419 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 13 19:19:37.411866 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.411671 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv"] Sep 13 19:19:37.484974 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.484942 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d627a961-c440-4263-a80b-879662387f86-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.485145 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.484981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tcpf\" (UniqueName: \"kubernetes.io/projected/d627a961-c440-4263-a80b-879662387f86-kube-api-access-2tcpf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.485145 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.485010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.485145 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.485104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.485298 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.485171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.485298 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.485205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.501743 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.501700 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:19:37.586237 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586208 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.586385 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586257 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.586385 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586289 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.586385 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586310 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.586385 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586339 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d627a961-c440-4263-a80b-879662387f86-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.586385 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586355 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcpf\" (UniqueName: \"kubernetes.io/projected/d627a961-c440-4263-a80b-879662387f86-kube-api-access-2tcpf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.586733 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586709 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.586804 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586738 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.586804 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.586776 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.588561 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.588542 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d627a961-c440-4263-a80b-879662387f86-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.588997 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.588972 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d627a961-c440-4263-a80b-879662387f86-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.593439 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.593415 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tcpf\" (UniqueName: \"kubernetes.io/projected/d627a961-c440-4263-a80b-879662387f86-kube-api-access-2tcpf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qk7tv\" (UID: \"d627a961-c440-4263-a80b-879662387f86\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.716656 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.716579 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:37.984894 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:37.984868 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv"] Sep 13 19:19:37.987629 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:19:37.987595 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd627a961_c440_4263_a80b_879662387f86.slice/crio-02692c5a1443607e4baa662e95bb99c9a744be14ed55cbb3ed2c5613385acdd5 WatchSource:0}: Error finding container 02692c5a1443607e4baa662e95bb99c9a744be14ed55cbb3ed2c5613385acdd5: Status 404 returned error can't find the container with id 02692c5a1443607e4baa662e95bb99c9a744be14ed55cbb3ed2c5613385acdd5 Sep 13 19:19:38.805210 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:38.805176 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" event={"ID":"d627a961-c440-4263-a80b-879662387f86","Type":"ContainerStarted","Data":"547c9eaa8a7d949d4bbd7146e4395a435fcca67fe813530bc4afa514f7d6ca94"} Sep 13 19:19:38.805631 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:38.805223 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" event={"ID":"d627a961-c440-4263-a80b-879662387f86","Type":"ContainerStarted","Data":"02692c5a1443607e4baa662e95bb99c9a744be14ed55cbb3ed2c5613385acdd5"} Sep 13 19:19:38.819811 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:38.819642 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" podStartSLOduration=1.6405115129999999 podStartE2EDuration="1.819622388s" totalImagesPullingTime="179.110875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 19:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:19:38.819536628 +0000 UTC m=+948.287097818" watchObservedRunningTime="2026-09-13 19:19:38.819622388 +0000 UTC m=+948.287183581" Sep 13 19:19:39.359645 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:39.359604 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:19:42.224166 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:42.224133 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:19:43.310273 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:43.310238 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:19:43.360184 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:43.360150 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:19:45.367501 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:45.367459 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-x6s4z"] Sep 13 19:19:47.717066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:47.717027 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:47.717542 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:47.717152 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:47.729416 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:47.729391 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:47.858826 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:47.858794 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qk7tv" Sep 13 19:19:59.490937 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:59.490902 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:19:59.589326 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:19:59.589298 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:21:25.632304 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:21:25.632260 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:21:25.758582 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:21:25.758546 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:21:28.749223 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:21:28.749187 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:21:28.849118 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:21:28.849082 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:21:53.944558 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:21:53.944525 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:21:54.284391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:21:54.284354 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:07.883049 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:07.883006 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:07.981650 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:07.981614 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:08.981044 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:08.981007 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:09.081759 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:09.081726 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:14.239691 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:14.239655 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:19.894448 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:19.894413 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:19.956118 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:19.956054 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:22.837579 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:22.837538 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gptfs_6c202984-6312-421c-8916-7cf331df8e91/global-pull-secret-syncer/0.log" Sep 13 19:22:22.979249 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:22.979217 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" Sep 13 19:22:23.073277 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:23.073250 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-197.ec2.internal_c2197d7e4b59d20da0b3277f8979b1b3/haproxy/0.log" Sep 13 19:22:27.942570 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:27.942541 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-x6s4z_46ad0f4c-4f5d-4cdc-a80d-da161e4d7fe1/limitador/0.log" Sep 13 19:22:29.717220 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:29.717187 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-97rzg_8021a7af-e0df-4909-aaab-54a9f311dfa2/kube-state-metrics/0.log" Sep 13 19:22:29.733829 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:29.733804 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-97rzg_8021a7af-e0df-4909-aaab-54a9f311dfa2/kube-rbac-proxy-main/0.log" Sep 13 19:22:29.752305 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:29.752275 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-97rzg_8021a7af-e0df-4909-aaab-54a9f311dfa2/kube-rbac-proxy-self/0.log" Sep 13 19:22:29.800344 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:29.800315 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-8s74j_3bde8337-455a-4472-9028-c164d7680a09/monitoring-plugin/0.log" Sep 13 19:22:29.828359 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:29.828330 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-947g8_1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c/node-exporter/0.log" Sep 13 19:22:29.847917 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:29.847893 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-947g8_1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c/kube-rbac-proxy/0.log" Sep 13 19:22:29.877434 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:29.877407 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-947g8_1c5bfa11-e50b-4f78-a2d0-0ed8e4f5359c/init-textfile/0.log" Sep 13 19:22:33.389589 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.389557 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cbd7c8495-x562f_c4bd4071-8bcc-435b-a296-7bfc5ba9597a/console/0.log" Sep 13 19:22:33.756661 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.756620 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs"] Sep 13 19:22:33.760077 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.760052 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.762289 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.762265 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-68dqb\"/\"default-dockercfg-l8csm\"" Sep 13 19:22:33.762420 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.762266 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-68dqb\"/\"openshift-service-ca.crt\"" Sep 13 19:22:33.763304 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.763283 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-68dqb\"/\"kube-root-ca.crt\"" Sep 13 19:22:33.769935 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.769906 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs"] Sep 13 19:22:33.802416 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.802363 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl7zz\" (UniqueName: \"kubernetes.io/projected/49ad2a4a-8e57-499b-a76b-d4307637391c-kube-api-access-vl7zz\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.802594 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.802455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-podres\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.802594 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.802506 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-sys\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.802594 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.802559 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-lib-modules\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.802733 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.802597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-proc\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903253 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl7zz\" (UniqueName: \"kubernetes.io/projected/49ad2a4a-8e57-499b-a76b-d4307637391c-kube-api-access-vl7zz\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-podres\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903329 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-sys\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-lib-modules\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903391 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903380 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-proc\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903538 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903436 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-sys\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903538 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903452 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-proc\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903538 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903472 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-podres\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.903538 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.903494 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ad2a4a-8e57-499b-a76b-d4307637391c-lib-modules\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:33.911161 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:33.911137 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl7zz\" (UniqueName: \"kubernetes.io/projected/49ad2a4a-8e57-499b-a76b-d4307637391c-kube-api-access-vl7zz\") pod \"perf-node-gather-daemonset-pl4fs\" (UID: \"49ad2a4a-8e57-499b-a76b-d4307637391c\") " pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:34.071899 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:34.071809 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:34.341725 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:34.341694 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs"] Sep 13 19:22:34.343581 ip-10-0-129-197 kubenswrapper[2555]: W0913 19:22:34.343553 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod49ad2a4a_8e57_499b_a76b_d4307637391c.slice/crio-4a6dca30d84e4049eb8a9077320fd1b4ead73e45191f4a802b00ce9d16fc60e8 WatchSource:0}: Error finding container 4a6dca30d84e4049eb8a9077320fd1b4ead73e45191f4a802b00ce9d16fc60e8: Status 404 returned error can't find the container with id 4a6dca30d84e4049eb8a9077320fd1b4ead73e45191f4a802b00ce9d16fc60e8 Sep 13 19:22:34.653291 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:34.653200 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" event={"ID":"49ad2a4a-8e57-499b-a76b-d4307637391c","Type":"ContainerStarted","Data":"97b51c641dc456c287c16701e3246fc7f015b6f7d433f0c06087f9960283b74c"} Sep 13 19:22:34.653291 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:34.653252 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" event={"ID":"49ad2a4a-8e57-499b-a76b-d4307637391c","Type":"ContainerStarted","Data":"4a6dca30d84e4049eb8a9077320fd1b4ead73e45191f4a802b00ce9d16fc60e8"} Sep 13 19:22:34.653718 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:34.653305 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:34.667844 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:34.667793 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" podStartSLOduration=1.66777463 podStartE2EDuration="1.66777463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 19:22:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 19:22:34.666615592 +0000 UTC m=+1124.134176783" watchObservedRunningTime="2026-09-13 19:22:34.66777463 +0000 UTC m=+1124.135335818" Sep 13 19:22:35.401634 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:35.401605 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-96g96_2bc80f67-6120-4bb9-97f1-4d4802174ba2/dns/0.log" Sep 13 19:22:35.421387 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:35.421363 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-96g96_2bc80f67-6120-4bb9-97f1-4d4802174ba2/kube-rbac-proxy/0.log" Sep 13 19:22:35.583012 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:35.582976 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t4xtb_a926d14e-1f9e-44e9-99b8-4f78d24c5b43/dns-node-resolver/0.log" Sep 13 19:22:36.252765 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:36.252738 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rj9p8_a8e1575a-c34e-41c5-a3c7-735fdbda759f/node-ca/0.log" Sep 13 19:22:37.201096 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:37.201063 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lkr99_2eb64d1e-3442-46d1-9c15-8b4023e0b994/discovery/0.log" Sep 13 19:22:38.041912 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:38.041882 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7cw7l_d34d8388-f6d9-4608-996e-c3238f3886e6/serve-healthcheck-canary/0.log" Sep 13 19:22:38.683659 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:38.683631 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8xdq_77d5c99b-a0d9-44e8-ae24-11819282cb53/kube-rbac-proxy/0.log" Sep 13 19:22:38.701804 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:38.701778 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8xdq_77d5c99b-a0d9-44e8-ae24-11819282cb53/exporter/0.log" Sep 13 19:22:38.720140 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:38.720117 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8xdq_77d5c99b-a0d9-44e8-ae24-11819282cb53/extractor/0.log" Sep 13 19:22:38.817735 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:38.817671 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-87sx4_f2e1573c-2405-45d0-938c-51b85cf35b8c/konnectivity-agent/0.log" limit=1024 Sep 13 19:22:40.667458 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:40.667422 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-68dqb/perf-node-gather-daemonset-pl4fs" Sep 13 19:22:41.031750 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:41.031713 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wb9rl_6b5ce730-3540-41e8-a91a-55443cb9635e/server/0.log" Sep 13 19:22:41.182809 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:41.182772 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65d87bcbcb-v4hxf_8604fd58-d485-4506-b720-a6c2501d0cd1/manager/0.log" Sep 13 19:22:41.197388 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:41.197360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65d87bcbcb-v4hxf_8604fd58-d485-4506-b720-a6c2501d0cd1/copy-manifests/0.log" Sep 13 19:22:42.459145 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:42.459115 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d96d9f8f5-jcn52_d36a55b7-2244-4012-8f1a-ca80cc6021d7/manager/0.log" Sep 13 19:22:42.481013 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:42.480984 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ftxxq_5d33791c-e1ad-4d3e-b279-806bf944d46a/openshift-lws-operator/0.log" Sep 13 19:22:44.674066 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:44.673948 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lkr99_2eb64d1e-3442-46d1-9c15-8b4023e0b994/discovery/0.log" Sep 13 19:22:46.035607 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:46.035573 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lkr99_2eb64d1e-3442-46d1-9c15-8b4023e0b994/discovery/0.log" Sep 13 19:22:49.443427 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.443396 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5s59c_f913dc6d-2f2a-41b9-a015-20f2a1962dae/kube-multus/0.log" Sep 13 19:22:49.463761 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.463734 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbbq4_27e4d6d9-86bc-43ac-b5fa-158b3fef5498/kube-multus-additional-cni-plugins/0.log" Sep 13 19:22:49.482091 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.482071 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbbq4_27e4d6d9-86bc-43ac-b5fa-158b3fef5498/egress-router-binary-copy/0.log" Sep 13 19:22:49.499261 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.499241 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbbq4_27e4d6d9-86bc-43ac-b5fa-158b3fef5498/cni-plugins/0.log" Sep 13 19:22:49.517233 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.517209 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbbq4_27e4d6d9-86bc-43ac-b5fa-158b3fef5498/bond-cni-plugin/0.log" Sep 13 19:22:49.535519 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.535497 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbbq4_27e4d6d9-86bc-43ac-b5fa-158b3fef5498/routeoverride-cni/0.log" Sep 13 19:22:49.553386 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.553365 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbbq4_27e4d6d9-86bc-43ac-b5fa-158b3fef5498/whereabouts-cni-bincopy/0.log" Sep 13 19:22:49.573610 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.573585 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbbq4_27e4d6d9-86bc-43ac-b5fa-158b3fef5498/whereabouts-cni/0.log" Sep 13 19:22:49.997093 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:49.997067 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q7q4c_597e5ef6-551e-4d79-abf3-59e08bb4565e/network-metrics-daemon/0.log" Sep 13 19:22:50.013611 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.013584 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q7q4c_597e5ef6-551e-4d79-abf3-59e08bb4565e/kube-rbac-proxy/0.log" Sep 13 19:22:50.802186 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.802154 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-488kp_fcd6e10f-957d-45cd-8990-b0c2ebfc73c6/ovn-controller/0.log" Sep 13 19:22:50.818589 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.818561 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-488kp_fcd6e10f-957d-45cd-8990-b0c2ebfc73c6/ovn-acl-logging/0.log" Sep 13 19:22:50.842804 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.842776 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-488kp_fcd6e10f-957d-45cd-8990-b0c2ebfc73c6/kube-rbac-proxy-node/0.log" Sep 13 19:22:50.866998 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.866953 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-488kp_fcd6e10f-957d-45cd-8990-b0c2ebfc73c6/kube-rbac-proxy-ovn-metrics/0.log" Sep 13 19:22:50.881559 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.881484 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-488kp_fcd6e10f-957d-45cd-8990-b0c2ebfc73c6/northd/0.log" Sep 13 19:22:50.901462 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.901431 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-488kp_fcd6e10f-957d-45cd-8990-b0c2ebfc73c6/nbdb/0.log" Sep 13 19:22:50.920092 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.920064 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-488kp_fcd6e10f-957d-45cd-8990-b0c2ebfc73c6/sbdb/0.log" Sep 13 19:22:50.956576 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:50.956544 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-488kp_fcd6e10f-957d-45cd-8990-b0c2ebfc73c6/ovnkube-controller/0.log" Sep 13 19:22:52.449002 ip-10-0-129-197 kubenswrapper[2555]: I0913 19:22:52.448966 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zj48k_2b7f9cc2-4c61-418e-950f-6b12d94e85d0/network-check-target-container/0.log"